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ABSTRACT 


Implementation  of  the  Taylor  Series  Video  Inage  Processing  (TSVTP) 
algorithn  for  tracking  and  guidance  is  presented  using  an  HP  2100  digital 
computer  to  solve  the  equation.  Closed  loop  svsten  operation  was  achieved 
using  a  Ret icon  100  x  100  matrix  photodiode  camera,  a  microprocessor  con¬ 
trolled  A/D  converter  as  an  interface  to  supply  signals  to  the  computer  and 
pan  tilt  servoes  operating  from  computer  generated  signals  to  control 
camera  position.  Tentative  studies  of  CCD  implementation  including  expen 
mental  data  are  presented  for  eventual  elimination  of  the  digital  computer. 
Alternate  algorithm  studies  compare  the  capabilities  of  complementing  and 
supplementing  methods  to  the  TSVTP.  A  hierarchy  of  algorithms  is  antici¬ 
pated  for  eventual  practical  implementation- 


Chapter  I 
INTRODUCTION 
1.1  Background 

This  report  describes  the  second  year  of  research  concerning  the  funda¬ 
mentals  of  tracking  and  guidance  using  computer  vision  with  an  emphasis  on 
Charge  Coupled  Device  (CCD)  discrete  analog  signal  processing  to  achieve  real 
time  operation  with  small  rugged  and  portable  hardware.  This  choice  of  signal 
processing  technology  provides  the  possibility  of  having  the  image  sensor  and 
processing  circuitry  on  the  same  substrate,  thereby  minimizing  the  interfacing 
problems  between  two  major  sections  of  the  system.  The  discrete  analog  nature 
of  the  circuitry  further  eliminates  A/D  and  D/A  hardware.  Refer  to  final 
report  number  ONR-CR233-092-1  for  a  complete  description  of  research  results 
for  the  first  year. 

Basically,  the  idea  of  the  system  is  to  compare  successive  frames  of  com¬ 
puter  vision  data  to  compute  relative  motion  and  displacements  in  three  dimen¬ 
sions.  This  information  is  then  used  to  derive  guidance  and/or  pointing  signals 
to  keep  the  desired  target  in  the  center  of  the  field  of  view.  A  major  concern 
of  the  research  has  been  the  problem  of  processing  rapidly  the  very  large 
quantities  of  data  required  for  effective  real  time  computer  vision  tracking. 

See  Chapter  II  and  last  year's  report  for  a  complete  description  of  the  system 
and  its  mathematical  representation. 

The  Taylor  Series  Video  Image  Processing  (TSVIP)  algorithm  was  developed  be¬ 
cause  an  adequate  algorithm  could  not  be  found  in  the  literature  that  appeared  to 
be  CCD  implemen table.  The  basic  tracking  algorithm  should  be  very  fast,  but  it 
need  not  necessarily  contain  pattern  recognition  ability,  registration  ability, 
edging  ability,  etc.  All  these  auxiliary  operations  can  be  obtained  at  a  rela¬ 
tively  slow  rate  if  the  tracking  algontnm  can  keep  the  system  functioning  while 
they  are  given  time  to  function.  And,  they  probably  will  eventually  be  required 

because  target  discrimination  with  a  very  high  level  of  confidence  is  a  major 
goal. 


1 
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The  TSVIP  operates  on  the  gradient  of  the  reflected  target  light  intensity, 
i.e.  ,  the  texture.  If  the  texture  function  at  a  point  on  the  target  is  described 
using  a  Taylor  series  and  then  truncated,  a  numerical  method  is  available  (called 
the  Euler  method)  for  extrapolating  texture  values.  However,  if  the  formula  is 
solved  for  displacement  of  the  target  from  the  reference  point,  then  texture 
measurements  from  successive  frames  of  data  yield  calculated  values  of  translation. 
If  multiple  points  are  measured  and  the  problem  formulated  to  include  the  affine 
transformation,  dilation  and  rotation  can  be  estimated  as  well  as  translation  in 
two  dimensions.  The  complete  formulation  is  described  in  the  previous  report. 

The  major  emphasis  this  year  has  been  on  implementation  to  validate  system 
concepts  and  signal  processing  technology.  Since  CCDs  are  specialized  devices, 
only  a  limited  amount  of  experimental  circuit  work  has  been  possible,  but  this 
was  known  beforehand  to  be  the  case.  However,  this  work  has  presented  many 
insights  and  given  credance  to  the  theoretical  implementation  work.  An  HP  2100 
digital  computer  with  associated  components  was  used  for  the  exerpimental 
system  and  is  described  in  Chapter  II.  The  CCD  implementation  work  is 

described  in  Chapter  III. 

Only  one  method  was  considered  during  the  first  year  for  the  required 
pseudoinverse  described  in  Chapter  II.  Iterative  methods  are  reported  in 
Chapter  IV  for  solving  the  estimation  equations,  i.e.,  obtaining  pseudoinverse 
results.  Chapter  V  contains  advanced  algorithm  work  in  which  the  TSVIP  and 
other  algorithms  are  compared.  Conclusions  are  written  into  each  section 
because  of  the  diverse  nature  of  the  individual  parts.  Chapter  VI  is  concerned 
with  recommended  future  work. 

Three  papers  have  been  written  on  the  results  to  date : 

1.  "Algorithm  Development  for  Real-Time  Automatic  Video  Tracking  Systems  " 
COMPSAC  Proceedings  (November  1979)  (invited  paper) . 


2.  "A  Model  and  Tracking  Algorithm  for  a  Class  of  video  Targets,"  accepted 
by  IEEE  Translations  on  Pattern  .Analysis  and  Machine  Intelligence  (1980) . 

3.  "CCD  Implementation  of  a  Novel  Video-Tracking  Algorithm,"  accepted  bv 
IEEE  Transactions  on  Pattern  Analysis  and  Machine  Intelligence  (1980) . 

It  is  anticipated  that  at  least  three  more  papers  will  be  published  on  the  recent 
results  of  the  research. 


The  second  year  goal  of  implementing  closed  loop  equations  was  achieved. 


CHAPTER  II 
EXPERIMENTAL  SYSTEM 

2.1  System  Description 

As  already  noted  an  experimental  system  was  constructed  to  test 
operation  of  the  TSVIP  algorithm  and  in  general  lend  credance  to  the 
theoretical  work  being  done.  A  block  diagram  of  the  system  is  shown 
in  Fig.  2.1.  A  Reticon  MC/RS  520  camera  [1]  system  acquires  data  from 
the  target  in  the  form  of  variation  in  light  intensity  or  texture 
and  outputs  a  video  signal  to  an  interface.  The  interface  converts 
this  information  into  a  digital  signal  and  latches  it  into  the 
computer.  The  computer  simulates  the  CCD  portion  of  the  TSVIP 
algorithm.  It  outputs  signals  to  control  a  pan  tilt  mount  in  two 
dimensions  although  operation  in  only  one  dimension  was  performed. 
This  pan  tilt  mount  responds  to  the  positional  control  signals  to 
keep  the  target  centered  in  the  camera  field  of  view. 

Developing  such  an  experimental  system  is  a  major  undertaking 
even  though  a  digital  computer  is  used  to  simulate  part  of  the 
hardware.  Closed  loop  operation  in  two  dimensions  was  achieved.  Slow 
delivery  of  parts  and  typical  hardware  problems  such  as  noise  and 
faulty  components  were  encountered  as  one  normally  expects. 

2.2  Hardware  Drivers 

A  device  driver  is  the  software  necessary  to  interface  the 
computer  with  the  actual  hardware.  It  provides  the  overall  system 
control  and  the  communication  between  the  hardware  and  the  computer. 
All  the  software  drivers  were  written  in  HP  assembler  language  in 


Positional  Control  Signals 


order  to  be  compatible  with  the  existing  system. 

In  order  to  understand  the  operation  of  the  device  drivers, 
it  is  necessary  to  present  brief  description  of  the  facilities. 

The  tracking  simulation  and  emulation  has  been  done  in  the  Control 
and  Computer  Systems  Laboratory.  Major  items  of  equipment  used  are: 

1)  HP  2 100 A  mini  computer 

2)  HP  magnetic  tape  drive 

3)  HP  disc  drive 

4)  Reticon  TV  camera 

5)  HP  X-Y  dispxjy 

6)  Tektronix  graphics  terminal 

7)  GE  Terminet 

8)  High  speed  tape  punch  and  optical  tape  reader 

9)  Pan  tilt  mount 

10)  Computer  controlled  motorized  arm 

The  HP  2100  has  a  core  memory  size  of  32K  and  can  run  under  Disc 
Operating  System  (DOS)  or  Binary  Control  System  (BCS),  the  former 
residing  on  the  disc  and  the  latter,  loaded  directly  into  core  memory 
[2].  Since  most  developmental  programs  were  written  in  Fortran  (with 
the  exception  of  the  drivers),  and  because  DOS  allows  relatively 
easy,  fast  editing,  compilation,  loading,  and  execution  of  routines 
in  both  Fortran  and  HP  Assembler,  DOS  was  used  exclusively. 

Rectangular  pulses  are  generated  and  sent  to  the  drivers  by  the 
HP  2100A  through  an  I/O  channel.  The  HP  2100A  is  a  mini  computer 
featuring  a  relatively  strong  instruction  set,  plug  in  interfaces 
and  modular  software.  Standard  features  include  memory  parity  generation 


and  checking,  memory  and  I/O  protect  for  executive  systems,  extended 
arithmetic  capability, and  power  fail  interrupt  with  automatic  restart. 

It  has  a  16  bit  word  length,  980  nanosecond  cycle  time,  and  80  basic 
instructions. 

Interfacing  of  peripheral  devices  is  accomplished  by  plug-in 
interface  cards  (see  Fig.  2.2).  The  computer  mainframe  can  accommodate 
up  to  14  interface  cards  and  up  to  45  with  the  I/O  extender  added. 

All  I/O  channels  are  buffered  and  bidirectional,  and  are  serviced 
through  a  multilevel  priority  interrupt  structure. 

The  17  I/O  instructions  provide  the  capability  to  set  or  clear 
the  I/O  flag  bits,  and  to  transfer  data  between  an  I/O  channel  and 
the  A  or  B  registers.  The  general  purpose  of  the  I/O  system  is  to 
transer  data  between  the  computer  and  external  devices.  Normally  data 
is  transferred  through  the  A  or  B  registers.  This  type  of  transfer 
occurs  in  three  distinct  steps: 

1)  between  external  device  and  its  interface  card  in  the  computer 

2)  between  the  interface  card  and  the  A  or  B  registers 

3)  between  the  A  or  B  registers  and  memory. 

This  three  step  process  applies  to  data  following  both  in  and 
out  of  the  memory.  The  basic  block  diagram  is  shown  in  Fig.  2.3. 

Hardware  controllers  are  connected  through  buffers  by  a  cable 
directly  to  an  interface  card  inside  the  computer.  The  interface 
card  in  turn  plugs  into  one  of  the  14  I/O  slots.  Each  slot  is  assigned 
a  fixed  address,  called  a  select  code.  The  computer  can  then  communicate 
with  the  device  on  the  basis  of  its  select  code  (see  Fig.  2.1). 

For  this  system,  Interface  cards  were  installed  in  the  slots 


corresponding  to  select  codes  16  and  36.  Data  to  be  transferred  are 
loaded  into  the  register  and  are  a  suitable  form  for  output.  The 
operation  begins  with  a  HP  assembly  language  program  instruction  to 
/transfer  the  data  from  the  A  register  to  the  interface  buffer.  The 
buffer  is  a  flip-flop  register  for  the  intermediate  storage  of  data 
and  its  data  capacity  is  16  bits.  Since  this  is  a  non- interrupt 
transfer,  and  control  and  flag  flip-flops  are  not  used,  the  sixteen 
bits  of  binary  data  are  immediately  transferred  to  the  external 
devices,  where  a  binary  zero  corresponds  to  zero  volts  and  a  binary 
one  corresponds  to  five  volts.  Pin  connections  for  these  interface 
cards  are  shown  in  Appendix  2.1. 

2.2.1  Pan  Tilt  Driver 

binary  one  can  be  stored  in  any  one  of  bits  twelve  to  fifteen 
(depending  on  the  desired  movement  of  the  pan  and  tilt  motors), 
causing  that  bit  to  be  high  and  output  five  volts  to  the  corresponding 
input  terminal  of  the  driver  hardware  [3,4).  Five  different  control 
word3  are  output  periodically,  one  at  a  time,  depending  on  which 
motor  is  to  be  operated  and  in  which  direction  it  is  to  be  moved. 
Figure  2.4  lists  the  code  used  for  the  control  words.  Rectangular 
pulses  are  sent  to  the  desired  input  of  the  driver  by  outputting  one 
of  these  four  control  words  or  0  periodically  in  order  that  the 
desired  motor  move  the  required  mzaber  of  steps. 

The  assembler  subroutine  is  called  by  this  FORTRAN  subroutine 

call: 

CALL  MOTORdSTEPI,  ISTEP2,  IDIR,  I  PER) 


where 


Fic-ure  2.4 


an  Tilt  .'5ount  Hardware  Control  Codes 
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ISTEP1  is  the  number  of  steps  to  be  taken  by  the  tilt  motor 
ISTEP2  is  the  niaber  of  steps  to  be  taken  by  the  pan  motor 
IDIR  is  the  direction  of  rotation 

0  for  CCW  tilt  and  CCW  pan  rotation 

1  for  CW  tilt  and  CCW  pan  rotation 

2  for  CCW  tilt  and  CW  pan  rotation 

3  for  CW  tilt  and  CW  pan  rotation 

IPER  is  the  speed  of  the  motors 

1  for  20  steps/second 

2  for  100  steps/second 

3  for  200  steps/second 

A  simple  flow  chart  of  the  program  is  illustrated  in  Fig.  2.5.  The 
actual  assembler  program  is  listed  in  Appendix  2.3. 

2.2.2  Camera  Driver 

The  driver  for  the  camera  controller  utilizes  non- interrupt  data 
transfers  and  direct  memory  access,  see  Figs.  2.6  and  2.7  (several 
of  the  figures  are  similar  to  information  from  [2,3]).  In  a  manner 
similar  to  the  pan  tilt  count,  the  computer  outputs  the  control  words 
to  the  camera  controller  by  a  non-interrupt  data  transfer;  but, 
because  the  data  rate  of  the  camera  output  is  faster  than  that  of  a 
non-interrupt  transfer  it  was  necessry  to  directly  transfer  the  data 
into  memory. 

As  already  mentioned  and  as  shown  in  Fig.  2.7,  the  purpose  of 
the  direct  memory  access  (DMA)  is  to  provide  a  direct  data  path  which 
is  software  assignable  between  memory  and  the  high  speed  peripheral 


f 

Similar  flowchart 
for  I’nn  Motor 


Figure  2.5  Flowchart  of  Pan  Tilt  Driver 


device.  DMA  accomplishes  this  purpose  by  stealing  a  memory  cycle 

instead  of  interrupting  to  a  service  routine.  When  DMA  is  accessing 

memory,  it  has  priority  over  the  central  processor’s  access  to  memory, 

The  DMA  data  rate  at  maximum  is  about  1  MHz  (16  bit  words)  but  in  our 
✓ 

case  it  was  about  500  KHz. 

The  DMA  transfer  is  initiated  by  an  initialization  routine  and 
from  then  on  operation  is  under  the  automatic  control  of  the  hardware 
The  initialization  routine  tells  the  DMA  hardware  which  direction  to 
transfer  the  data,  where  to  put  the  data  in  memory,  which  I/O  channel 
to  use,  and  how  much  data  to  transfer.  This  information  is  given  by 
three  control  words.  These  three  words  must  be  addressed  specifically 
to  the  DMA  card.  Figure  2.7  shows  the  format  of  the  three  control 
words.  Control  Word  1  identifies  the  I/O  channel  to  be  used,  and 
provides  two  options  not  used  in  our  software  (Option  1  is  the  STC 
and  CLF  to  the  I/O  channel  at  the  end  of  each  DMA  cycle  and  Option 
2  is  the  CLC  to. the  I/O  channel  at  the  end  of  a  block  transfer). 

Control  Word  2  gives  the  starting  memory  address  for  the  block 
transfer  and  Bit  15  of  this  word  determines  whether  data  is  to  go 
Into  memory  or  out  of  memory.  Control  Word  3  is  the  2's  complement 
of  the  number  of  words  to  be  transferred  into  or  out  of  memory  (i.e. 
length  of  the  block).  This  number  can  be  from  -1  to  -32768  although 
it  i3  obviously  limited  by  the  size  of  the  available  memory. 

For  the  non-interrupt  portion  of  the  data  transfer,  four  control 
word3  are  sent  to  the  camera  controller:  XSTART,  YSTART,  XSTOP,  and 
YSTOP.  The  first  seven  bits  (0  -  6)  of  each  word  identify  a  starting 
or  stopping  address  for  the  software  selectable  camera  window.  The 
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seventh  and  eighth  bits  of  each  control  word  identifies  the  control 
word.  The  ninth  bit  of  the  last  control  word  initiates  the  camera 
output. 

In  this  manner,  any  portion  of  the  camera  picture  (100x100)  can 
be  selected  for  processing.  This  became  a  necessity  for  the  experimental 
system  due  to  the  limited  memory  available  and  processing  speed.  The 
software  drivers  for  both  of  these  processes  can  be  found  in  Appendix 
2.3. 


2.3  Video  Interface 

A  brief  description  of  the  camera  is  necessary  before  the 
interface  can  be  discussed  (2).  The  camera  is  a  Reticon  MC  520 
photodiode  camera.  It  provides  a  100  x  100  pixel  discrete  analog 
picture.  The  output  is  pixel  hy  pixel,  row  by  row  string  of 
sampled-and-held  pulses.  Each  pulse  represents  the  grey  level  at  a 
particular  pixel  in  the  image  matrix.  When  the  MC  520  is  used  in 
conjunction  with  its  companion  controller,  the  RS  520,  (as  it  was  in 
this  case)  various  synchronizing  signals  are  made  available  to  the 
user.  A  pixel  clock  (GCLK)  is  synchronized  with  the  beginning  of  each 
sampled-and-held  pulse  of  video  data  and  is  blanked  during  all  retrace 
intervals.  The  line  enable  (LEN)  signal  is  valid  during  each  rcw  of 
100  pixels  and  provides  a  means  of  knowing  which  rcw  of  the  video 
data  is  being  "clocked  out"  at  any  given  time.  The  frame  enable  (FEN) 
signal  is  valid  during  each  entire  100  x  100  pixel  frame  and  invalid 
during  the  retrace  interval  between  frames.  It  allows  the  user  to 
easily  synchronize  his  equipment  with  the  start  of  any  picture  frame. 
These  signals  make  the  design  of  the  video  interface  fairly 


straightforward. 

The  interface  had  to  meet  certain  requirements.  First,  and 
foremost,  it  had  to  provide  some  form  of  data  reduction.  Each  100  x 
100  pixel  image  required  10,000  words  of  computer  svorage.  If  it 
were  necessary  that  two  successive  image  frames  be  stored  in  memory 
simultaneously  then  there  would  be  little  memory  available  for 
programs.  Thus,  some  form  of  data  reduction  was  imperative.  Since 
the  tracking  algorithm  utilized  only  those  image  points  within  the 
target,  a  means  of  selecting  out  only  those  particular  pixels  for 
transmission  was  needed.  The  technique  employed  will  be  described  in 
the  general  description  of  the  interface.  The  interface  was  also 
required  to  digitize  the  discrete  analog  image  into  a  sufficient 
number  of  grey  levels  at  speeds  approaching  one  megahertz,  the  D.M. A. 
rate  of  the  HP  2100. 

Finally  the  interface  was  required  to  allow  the  camera  to  clock 
out  image  frames  continuously.  This  was  required  to  prevent  saturation 
of  the  photodiode  array.  The  camera  operates  by  integrating  the  light 
incident  on  each  photodiode  for  the  entire  period  between  which  each 
photodiode  is  sampled.  Thus  allowing  the  camera  to  "sit"  and  only 
clock  out  frames  on  demand  would  allow  it  to  integrate  light  for  too 
long  a  period  of  time  between  samplings.  This  would  result  in  the 
saturation  of  the  photodiode  array.  To  avoid  this  saturation  the 
camera  was  allowed  to  run  freely,  clocking  out  frames  continuously. 
When  the  computer  signals  the  interface  to  ask  for  the  next  image 
frame,  the  interface  must  be  able  to  find  the  beginning  of  the  next 
available  image  frame  and  begin  data  transmission  with  the  first 


19 


pixel  in  the  frame.  The  means  by  which  this  requirement  and  all  the 
other  requirements  were  satisified  will  become  clear  as  the  interface 
is  described. 

The  camera-computer  interface  consists  of  two  major  subsystems. 

The  digital  subsystem  allows  the  user  to  select  a  desired  portion  of 
an  image  for  transmission  to  the  computer.  The  analog  subsystem 
performs  the  analog  to  digital  conversions  necessary  for  communication 
with  a  digital  computer.  The  entire  interface  resides  on  one  4.5  by 
9  inch  wire  wrap  circuit  card.  It  is  installed  in  the  520  controller 
which  has  extra  slots  in  its  card  cage  meant  specifically  for  user 
hardware  such  as  the  interface. 

The  digital  subsystem  allows  the  user  to  select  from  software 
a  rectangular  (or  square)  "window"  or  subsection  of  the  entire  image 
for  transmission  to  the  computer.  The  useh.  specifies  the  parameters 
of  the  desired  window  by  transmitting,  to  the  interface,  four  control 
codes  specified  in  software.  A  frame  is  acquired  by  sending  "go" 
command  which  is  usually  issued  with  the  last  control  code. 

The  operation  of  the  digital  subsystem  is  best  understood  by 
separating  its  operation  into  an  initialization  mode  and  a  run  mode. 
Figures  2.3,  2.9,  and  2.10  should  be  referred  to  throughout  this 
description.  The  initialization  mode  allows  the  user  to  program  the 
interface  which  specifies  the  software  selectable  window.  Bits  seven 
and  eight  of  the  16  bit  computer  word  are  used  to  select  which  of 
four  eight  bit  (only  seven  bits  used)  latches  is  to  be  initialized. 

Bits  zero  to  six  of  each  word  are  then  used  to  initialize  each  of 
the  four  latches.  Each  latch  contains  the  coordinates  within  the  100 


Figure  2.9  Analog  Subsection  of  Video  Interface 


x  100  pixel  array  of  the  start  or  stop  postion  of  the  column  or  row 
desired.  The  four  codes  are  referred  to  as  XSTART,  XSTOP,  YSTART, 
and  YSTOP  and  indicate  the  starting  column,  ending  column,  starting 
row,  and  ending  row,  respectively  of  the  desired  window.  Figures  2.8 
and  2.10  provide  an  illustration  of  this. 

The  term  "run  mode"  is  actually  a  slight  misnomer  since  the 
digital  subsystem  is  actually  free  running  while  its  output  is  disabled 
until  a  "go"  command  is  issued.  The  four  4  bit  counters  (01,  U2,  Oil, 
and  012)  are  used  in  pairs  to  form  two  8  bit  counters  in  order  to 
keep  track  of  the  pixel  whose  value  is  being  clocked  out.  The 
"X-counter"  is  clocked  by  the  logical  complement  of  GCLK,  the  pixel 
clock,  which  occurs  as  each  successive  pixel  clocked  out.  It  is  reset 
by  the  LEU  signal.  Thus  the  value  of  the  X-counter  at  any  given  time 
is  the  column  coordinate  of  the  pixel  being  clocked  out  at  that  time. 
The  "Y-counter",  which  is  clocked  by  the  LEN  signal  and  reset  by  the 
the  FEN  signal,  keeps  track  in  a  similar  fashion  of  the  row  coordinate 
of  the  pixel  being  clocked  out.  Thus  the  values  of  the  X  and  Y  counters 
taken  together  provide  the  coordinates  of  the  pixel  being  clocked 
out  at  any  given  time. 

Digital  comparators  (U3,  U4,  U9,  and  U10)  are  used  to  compare 
the  location  of  the  pixel  being  clocked  out  at  a  particular  time  to 
the  location  of  the  window  limits  as  stored  in  the  four  latches  during 
initialization.  The  output  of  the  comparators  provides  the  information 
necessary  to  know  whether  the  pixel  being  clocked  out  is  within  the 
specified  window.  The  XSTART  and  XSTOP  comparators  set  and  reset, 
respectively  a  flip-flop  (U16a)  whose  output  status  tells  whether 
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the  column  coordinate  of  the  pixel  being  clocked  out  is  within  the 
specified  window.  The  YSTART  and  YSTOP  comparators  provide  the  same 
information  about  the  row  coordinate  by  setting  and  resetting  another 
similar  flip-flop  (0163).  Thus,  by  combining  the  outputs  of  the  two 
flip-flops  using  a  logical  AND  function  provides  a  single  digital 
signal  whose  status  tells  whether  the  pixel  being  clocked  out  is 
within  the  desired  window.  The  window  status  signal  combined  with 
information  as  to  whether  a  frame  request  has  been  made  is  used  to 
appropriately  enable  or  disable  the  clock  to  the  analog  subsystem. 

The  user  makes  a  request  to  acquire  a  frame  by  setting  bit  nine 
of  the  last  control  word.  This  bit  is  clocked  into  a  D-type  flip-flop 
(U17B)  by  the  FEN  signal.  This  causes  the  output  of  the  flip-flop  to 
be  synchronized  with  the  start  of  the  next  available  frame.  The  output 
of  this  flip-flop  combined  by  a  logical  AND  function  (U15)  with  the 
window  status  signal  is  used  to  enable  the  clock  to  the  analog 
subsystem. 

The  main  task  of  the  analog  subsystem  is  to  perform  analog-to-digital 
conversion.  This  subsystem  consists  of  high  performance  operational 
amplifier,  and  eight  bit  one  megahertz  analog-to-digital  converter, 
and  an  eight  bit  latch.  A  schematic  diagram  is  shown  in  Figure  2.9. 

The  operational  amplifier  gain  of  -2.5  serves  to  scale  the  2  volt 
maximum  sampled-and-held  video  from  the  camera  to  a  0  to  -5  volt 
range  so  as  to  make  use  of  the  entire  dynamic  range  of  the  ADC.  The 
ADC  is  capable  of  performing  conversions  at  speeds  up  to  one  megahertz. 

The  actual  clock  rate  is  set  by  adjusting  the  internal  clock  of  the 
RS  520  camera  controller.  The  latch  connected  to  the  ADC  output  holds 
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each  conversion  result  for  an  entire  conversion  period  to  allow 
sufficient  time  for  the  computer  to  read  each  piece  of  data.  The 
st art- conversion  (STC)  signal  to  the  ADC  is  the  output  of  the  digital 
subsystem.  Thus,  the  ADC  only  receives  STC  signals  when  a  frame  has 
been  requested  by  the  user  and  the  pixel  being  clocked  out  is  within 
the  user  specified  window. 

The  operational  details  of  the  control  codes  required  to  initialize 
the  interface  are  as  follows: 

CODE  BIT 

XSTART 
XSTOP 
YSTART 
YSTOP 

YSTOP  with  "go" 
where  X  is  user  specified. 

One  important  point  to  note  is  that  after  a  frame  request  is 
made  by  sending  the  last  control  code  with  bit  9  set,  this  bit  must 
be  reset  and  then  set  again  when  a  frame  is  next  requested.  Failure 
to  reset  bit  9  of  the  latched  output  port  between  frame  requests  will 
render  the  frame  synchronizing  apparatus  ineffective. 

\ 

The  interface  is  an  open  loop  device.  This  means  that  it  provides 
no  handshaking  lines  (other  than  the  usual  strobe  or  flag)  either 
when  latching  control  codes  or  transmitting  data  to  the  computer.  To 
assure  consistent  operation,  the  system  clock  (interned  to  RS  250) 
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nust  be  set  at  less  than  800  KKz.  In  this  way  the  D.M.A.  rate  of  the 
HP  2100  is  not  exceeded  and  the  propagation  delay  inherent  in  latching 
the  output  of  the  ADC  is  taken  into  account. 


2.4  Tracking 

The  purpose  of  this  section  of  the  system  is  to  estimate  the 
affine  parameters  using  the  TSVIP  algorithm.  [5] .  A  brief  development  of 
the  algorithm  is  given  below  (see  0NR-CR-23 3-0 92-1  for  complete 
details): 


d  =  D  a 
%  cv 
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d  is  the  N  x  1  scene  difference  vector 


a  is  the  4x1  total  affine  narameter  vector 
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where 
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The  affine  vector  can  be  estimated  by 


a  = 
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Software  was  developed  to  implement  this  algorithm  with  two  intentions 
in  mind:  first,  ease  of  implementation;  and  second,  ease  of  modification. 
Therefore  the  software  took  the  form  of  one  overall  control  algorithm 
and  many  array  processing  subroutines.  The  software  is  well  documented 
and  fairly  straightforward  following  the  development  found  on  the 
previous  page.  The  software  can  be  found  in  Appendix  2.3. 

2.5  Open  Loop  Tracking 

Upon  completion  and  testing  of  the  software  and  hardware,  the 
relationship  between  relative  position  and  estimated  position  was 
examined.  Figures  2.11,  2.12,  and  2.13  demonstrate  the  sensitivity 
of  the  experimental  system  to  noise.  A  great  deal  of  noise  smoothing 
had  to  be  incorporated  into  the  tracking  system  in  order  to  compensate 
for  the  slow  sampling  rate  (once  every  30  seconds)  and  a  very  noisy 
lighting  environment.  With  a  greater  processing  speed  (such  as  CCD 
technology  is  now  capable  of),  a  faster  sampling  rate  can  be  achieved 
which  theoretically  should  decrease  the  magnitude  of  changes  in  the 
target’s  lighting  environment. 

After  the  effect  of  noise  has  been  reduced.  Figure  2.13  shows 
that  the  TSVIP  algorithm  does  generate  linear  position  estimates  for 
small  target  movements  from  the  origin.  With  a  fast  enough  system 
sampling  rate,  all  target  movements  can  be  limited  to  this  range. 

2.6  Closed  Loop  Tracking 

Once  the  TSVIP  algorithm  produces  positional  estimates,  it  is 
necessary  to  translate  then  into  pan  tilt  control  signals.  Since  a 
priori  knowledge  of  the  target  size  and  distance  to  the  sensor  is 
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not  available,  an  alternate  method  is  needed.  A  straightforward  method 
is  to  move  the  camera  in  the  direction  followed  by  the  target  with 
a  constant  step  size  until  the  error  is  within  certain  limits.  This 
method  generally  guaranteed  convergence  at  the  expense  of  processing 
time. 

A  second  approach  has  been  tested  where  the  values  for  guidance 
control  signals  were  found  by  interpolating  between  the  previous  and 
present  postion  estimates  and  the  previous  control  signal.  This 
algorithm  was  much  faster  than  the  previous  one  but  was  very  sensitive 
to  noisy  position  estimates  as  long  as  the  target  was  in  the  linear 
region  of  the  TSVIP  algorithm.  Outside  of  this  region,  the  response 
time  of  this  algorithm  was  decreased  although  it  was  still  better 
than  that  of  the  first  method.  This  deficiency  could  be  avoided 
provided  that  the  system  sampling  rate  was  fast  enough  to  limit  target 
motion  to  this  range. 

A  real  environment  tracking  sequence  of  scenes  copied  from  the 
graphics  display  can  be  found  in  Appendix  2.4.  The  initial  scene 
shows  the  position  of  the  target  after  it  has  moved  away  from  the 
origin.  The  remaining  images  display  the  target  position  after  computer 
simulating  the  TSVIP  algorithm  attempts  to  center  the  target  in  its 
coordinate  system.  Note  that  the  sequence  ends  when  the  computer  has 
successfully  tracked  the  target  back  to  its  origin. 

Closing  the  feedback  loop  allows  any  errors  generated  from  the 
previous  position  estimates  or  camera  position  control  signals  to  be 
corrected  as  can  be  seen  in  Appendix  2.4.  It  took  eight  iterations 
for  our  tracking  system  to  track  the  target  back  to  its  origin  but 
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with  an  increase  in  processor  speed  as  with  CCD  technology  real  time 
video  tracking  becomes  a  reality.  Since  it  is  impossible  to  increase 
the  computation  speed  of  the  HP  2100,  it  was  necessary  to  3low  down 
the  target  motion.  Moving  at  a  speed  which  kept  the  target  in  the 
field  of  view  of  the  camera,  any  single  target  which  could  be  segmented 
from  the  background  was  capable  of  being  tracked  for  any  length  of 
time  as  long  as  the  above  conditions  were  met. 


CHAPTER  III 

CCD  IMPLEMENTATION 

3.1  Introduction 

Algorithms  such  as  the  TSVIP  require  the  manipulation  of  matrices  with 
variable  elements.  Matrix  multiplication  is  the  most  commonly  performed  opera¬ 
tion.  but  in  some  cases  matrix  inversion  is  also  necessary.  The  TSVIP  algorithm 
(in  reduced  form)  requires  the  inversion  of  a  2x2  matrix  with  variable  elements. 
This  inversion  can  be  performed  using  only  one  analog  divider  (in  addition  to 
CCD  registers  and  analog  multipliers) .  The  block  diagram  and  schematic  diagrams 
for  the  implementation  of  the  complete  TSVIP  were  presented  in  the  final 
report  for  the  period  August  1978  -  August  1979  (Report  0NR-CR2 33-092-1) .  The 
processor  requires  16  subsystems,  all  of  which,  except  the  spatial  derivative 
estimator  use  CCD  devices.  Some  require  analog  multipliers  also,  and  only 
one,  as  mentioned  above,  an  analog  divider.  It  is  suggested  in  [6]  that  the 
use  of  analog  dividers  can  be  avoided  in  matrix  inversion  if  the  method  of 
inversion  by  products  is  used.  However  this  still  requires  the  use  of  analog 
multipliers  plus  n  digital  divisions  for  the  inversion  of  an  n  x  n  matrix. 

For  a  2  x  2  matrix  it  seems  that  the  disadvantages  of  this  method  outweigh 
the  possible  advantages,  and  the  use  of  a  single  analog  divider  is  adequate. 

Several  methods  for  the  implementation  of  programmable  filters  which  can 
be  extended  to  matrix  operations  have  been  rei.~~ted  in  the  literature.  The 
most  promising  one,  [7],  uses  a  combination  of  CCDs  and  digital  shift  registers 
for  the  multiplication  of  a  variable  vector  by  a  matrix  with  elements  known  a 
priori.  More  details  on  this  approach  will  be  given  in  Sect.  3.3.  The  method 
could  be  used  also  for  a  variable  matrix,  but  the  speed  of  operation  would 
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then  be  slowed  down  by  the  loading  time  of  the  shift  register,  plus  the  A/D 
conversion  time.  Except  for  this  possibility,  no  other  method  for  variable 
matrix  operations  has  been  reported,  to  our  knowledge,  which  avoids  the  use 
of  analog  multipliers. 

3.2  Sum  of  Products  (SOP)  Matrix  Manipulator 

Carroll,  [6],  uses  only  serial  input/parallel  output  (SIPO)  devices  to 
implement  his  basic  SOP  cell  shown  in  Fig.  3.1.  It  should  be  noted  that 
although  apparently  simple,  this  cell  has  the  disadvantage  of  producing  the 
elements  of  the  resulting  matrix  at  different  time  instants.  Consequently 
additional  circuitry  not  shown  in  the  figure  becomes  necessary  in  order  to 
store  the  elements  of  the  resultant  matrix  for  use  in  other  parts  of  the 
circuit,  or  as  a  final  output.  To  obtain  the  product  of  two  matrices,  one 
matrix  is  first  loaded  by  columns  and  then  the  second  matrix  is  "paraded" 
left-to-right  by  rows,  at  consecutive  clock  pulses.  The  product  of  an  m  x  p 
matrix  A  by  a  p  x  n  matrix  B  can  be  accomplished  with  p  SOP  cells  in  2m+n-l 
clock  pulses.  This  includes  the  loading  of  A  and  the  "parading"  of  B.  With 
reference  to  Fig.  3.1,  if  we  want  to  multiply  two  2x2  matrices 

(3.2.1) 

A  is  loaded  during  the  first  two  clock  pulses.  During  the  3rd  clock  pulse  b 
is  leaded  at  input  1  and  b  at  input  2.  The  output  at  t^  is  then  c^  at  out¬ 
put  1,  where  c^  =  a^b.^  +  ai2b21'  an<3  zero  at  outPut  2.  Table  3.1  shows  the 
outputs  from  t^  to  t^.  Note  that  five  clock  pulses  are  needed,  in  agreement 
with 

T  =  2m+n-l 
=  4+2-1 
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(3.2.2) 


Fig.  3.1  Basic  SOP  Cell 

(1)  Load  row  1  of  matrix  [B]  starting  with  b  at  clock 
pulse  1 

(2)  Load  row  2  of  matrix  [B]  starting  with  at  clock 
oulse  1 
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Exactly  the  same  cell  can  be  used  to  multiply  a  g  x  2  matrix  by  a 
matrix.  The  required  time  will  then  be 

T  =  2q  +  n  -  1  clock  pulses 

TABLE  3.1 


OUT  1 
OUT  2 
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V* 


loading  A 
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Cli 


'12 


'21 


'22 


With  reference  to  the  block  for  the  implementation  of 

-1 


[P] 


+  =[PCT  Pc]  [pc] 


given  in  the  previous  report  and  repeated  in  Fig.  3.2  for  convenience, 

T 

that  it  can  be  implemented  by  the  circuit  of  Fig.  3.1,  because  [P^  Pc] 
T 

2x2  and  P  is  2xN.  For  the  subsystem  of  Fic.  3.2,  we  had 
c  ' 
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(3.2.4) 


we  see 
-1 

is 


(3.2.5) 


(3.2.6) 


(3.2.7) 


If  the  system  of  Fig.  3.1  is  used,  the  operation  would  require  N+3 
clock  pulses  (at  frequency  NF) .  Using  the  circuit  of  Fig.  3.2  only  N  clock 
pulses  are  required.  The  CCD  devices  of  Fig.  3.2  are  more  complex  than  those 
of  Fig.  3.1,  however,  but  the  outputs  are  all  obtained  simultaneously  by 
means  of  analog  switches  at  the  parallel  outputs  of  the  SIPO  devices.  SIPO 
devices  can  be  operated  in  general  at  a  higher  frequency  than  PISO  devices, 
and  if  a  very  high  frequency  of  operation  is  required,  the  approach  of 
Fig.  3.1  should  be  considered. 

3. 3  Digital/Analog  Matrix  Manipulator 
3.3.1  A  Programmable  Digital/Analog  Correlator 

Some  of  the  programmable  transversal  filters  or  correlators  reported  in 
the  literature  use  digital  storage  and  a  simple  FET  analog  multiplier,  [3]. 

As  already  noted  in  the  previous  report,  the  usefulness  of  such  devices  is 
doubtful.  Recently,  [8],  a  different  architecture  which  utilizes  digital 
storage  and  multiplying  DACs  has  been  reported  although  the  most  practical 
approach  seems  to  be  the  one  reported  in  reference  [7].  A  programmable 
digital/analog  correlator  capable  of  performing  an  n-stage  programmable 
correlation  which  does  not  require  multiplication  is  shown  in  Fig.  3.3.  The 
output  of  this  device  in  the  z-domain  is 
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(3. 3.1.1) 


where 
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(3. 3.1.2) 
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tn 

is  the  n  weight,  represented  with  M  bit  precision .  Notice  that  K  delay  lines 
and  digital  shift  registers  are  needed.  The  analog  signal  at  each  CCD  tap 

k 

outout  is  "nultiolied"  bv  the  binarv  value  h  (which  is  either  0  or  1)  by 

n 

either  sensing  or  not  sensing  each  analog  charge  packet  once  the  n  values  of 

-k 

V  have  been  loaded  into  the  CCD  device.  The  2  attenuation  (0<k<M-l)  at 
m  - 

the  input  of  each  delay  line  is  achieved  by  means  of  capacitive  ratio  techniques. 
An  off-chip  integrating  amplifier  is  used  to  sum  the  correlator  outputs.  The 
slew  rate  of  this  amplifier  limited  the  sampling  rate  of  the  correlator 
reported  in  [7]  to  5 CO  KHz. 


3.3.2  Use  of  the  Programmable  Digital/Analog  Correlator  for 

Matrix  ©Derations 


Some  of  the  algorithms  described  in  Chapter  V  of  this  report  require  the 
computation  of  image  moments  of  the  type 

m  n 

M  =  l  l  p*(i,j)x  (3. 3. 2.1) 

i=-m  j=-n 

where  the  windowed  image  p'(i,j)  is  of  size  (2m+l) (2n+l)  and  is  the  distance 

in  the  x  direction  from  the  center  of  the  window.  The  x  can  then  be  con- 

s 

sidered  as  weights  of  the  image  intensities  p *  (i , j ) .  Formula  (3. 3.2.1)  can  be 
rewritten  as 


mm  m 

M  =  /  o’(i,-n)x.  =  J  o' (i, (-n+1) )x.  +•••+  T  p’(i,n)x.  (3. 3.2.2) 

x  **  1  1  .  1 

i=-m  i=-m  i=-m 

Each  one  of  the  addends  in  (3. 3.2.2)  can  be  obtained  with  a  correlator  of 
the  type  shown  in  Fig.  3.3.  From  (3. 3. 2. 2), 
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(3. 3. 2. 4) 
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The  correlator  to  implement  (3. 3. 2. 3)  requires  2m+l  taps  for  the  delay 
lines  and  2m+l  bits  for  the  digital  shift  registers.  The  number  M  of  delay 
lines  and  shift  registers  is  determined  by  the  required  -  »racy.  A  total 
of  2n+l  correlators  is  necessary  to  implement  M  The  final  configuration 
is  as  shown  in  Fig.  3.4,  where  every  block  has  the  architecture  of  Fig.  3.3- 
Notice  that  the  p' (i, j)  are  loaded  serially  into  the  CCD  devices  and  that  x^, 
a  value  known  as  priori,  is  loaded  only  once  into  the  digital  shift  registers. 

The  operation  performed  by  the  system  of  Fig.  3.4  is  similar  to  the 
multiplication  of  a  matrix  by  a  vector.  In  this  case  the  vector  x  being  a 
constant  vector.  If  it  is  desired  to  perform  a  similar  multiplication  with  a 
vector  of  variable  elements ,  an  ADC  is  necessary’  in  order  to  obtain  the 
digital  representation  of  the  vector  elements.  In  addition,  each  digital 
shift  register  would  have  to  be  reloaded  for  each  new  multiplication.  Since 
the  rows  of  the  matrix  also  have  to  be  reloaded  serially  into  the  CCD  devices, 
the  processing  time  would  only  be  slowed  dawn  by  the  A  to  D  conversion  time. 

3.3.3  Use  of  the  Diqital/Analoc  Correlator  for  the 
Imolementation  of  the  TSVIP 


i.’ith  reference  again  to  the  implementation  of  the  pseudoinverse  matrix 


[?  ]  in  the  TSVIP,  we  have,  from  (3.2.5)  and  3.2.6), 
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Defining 
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(3.3.3.2a) 


(3.3.3.2b) 


(3.3.3.2c) 


j  =  1 ,2  ;  m=l ,2 , . . . ,N 


the  matrix  multiplication  (3. 3. 3.1)  can  be  expressed  in  terms  of  the  multipli¬ 
cation  of  the  2x2  matrix  [q]  and  the  vectors 


as  follows , 
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(3. 3. 3. 5) 


The  element  c^of  can  be  implemented  as  shown  in  Fxg.  3.5.  The  element 
c^2  of  c_  is  implemented  by  exactly  the  same  architecture  with  the  input  to  the 
delay  line  changed  to  q  ,  qon  instead  of  q  ,  o  .  For  both  elements,  the 
input  to  the  ADC  is  P^/  P-^ ,  secluentially ,  which  indicates  that  only  one  ADC 
is  needed  for  each  c^.  Notice  that  the  timing  must  be  such  that  when  q^  is 
the  output  of  the  delay  and  q^  is  at  the  input  to  the  delay,  p  must  have 
been  converted  and  shifted  to  the  right,  and  p  must  have  been  converted,  as 
indicated  in  Fig.  3.5.  Notice  also  that  the  hardware  could  be  reduced  by  half, 
since  q  ,  q  and  q^2  could  be  entered  sequentially  (here  the  symmetry  of  the 


matrix  allows  us  to  use  three  inputs,  instead  of  four)  to  the  delay,  producing 


c  and  c  sequentially  at  the  output.  The  processing  time  would,  however. 


ifr  »-rt-Kr«esEwjf, 
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be  larger,  and  means  of  storing  c^  while  c^  is  being  computed  would  be 
necessary. 

If  the  parallel  approach  is  used,  2N  blocks  are  needed.  If  the  sequential 
approach  is  used,  N  blocks  are  needed,  plus  the  extra  circuitry  necessary  to 
store  c  while  c^n  is  being  computed.  The  all  parallel  block  diagram  is 
shown  in  Fig.  3.6. 

Another  possibility  is  the  all-serial  processor,  in  which  a  single  block 
of  the  type  shown  in  Fig.  3.5  is  used.  The  j^s  are  converted  and  loaded 
sequentially  into  the  digital  shift  register,  from  j=l  to  j=N.  For  each  , 
q^,  q  and  <^2  are  i°a<^e<^  sequentially  into  the  CCD  delay  line,  and  the 
multiplication  performed.  The  elements  of  the  matrix£Pc]+  ,  c_.^»  appear 
sequentially  at  the  output  of  the  device  and  must  be  stored.  The  processing 
time  will  be  N  times  larger  than  that  for  the  parallel-serial  processor, 
but  the  hardware  will  be  reduced  from  N  to  1.  Notice  that  only  one  ADC  is 
necessary  in  this  case.  The  times  required  for  the  three  cases  are: 

a)  All  parallel  processor, 


T  =  (ADC)  .  +  2t 

p  time 


(3. 3. 3.6) 


where  t  is  a  clock  pulse  time, 

b)  Serial-parallel  processor, 


T  =  (ADC)  .  +  3t 

sp  time 


c)  All-serial  processor, 


T  =  N-  (ADC)  .  +  N • 3t 

s  time 


(3. 3. 3.7) 


(3. 3. 3. 8) 


=  N’T 

sp 

From  the  point  of  view  of  speed,  the  serial-parallel  processor  represents 
the  best  approach,  because  it  requires  considerably  less  hardware  than  the  all¬ 
parallel,  with  a  very  small  increase  in  processing  time. 
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For  the  all-analog  system  of  Fig.  3.2,  N  clock  pulses  at  a  frequency  F 
are  needed  for  one  computation.  In  that  case  it  was  assumed  that  the  PISO 
devices  could  operate  at  a  frequency  NF.  If  the  same  assumption  is  made  for 
the  digital/analog  system,  the  all  serial  processor  would  require  a  time  equal 
to  3  clock  pulses  of  the  basic  frequency  F  plus  N  times  the  ADC  time.  High 
speed  ADCs  have  conversion  rates  of  about  100  ns  for  8  bit  accuracy.  For  a 
basic  frequency  of  1  MHz  and  N  =  9 ,  the  all  serial  processor  could  compete 
in  speed  with  the  all-analog  processor.  It  must  be  emphasized  that  if  higher 
basic  frequency  rates  are  used,  or  N  is  much  larger  than  8,  the  all-serial 
processor  will  require  considerably  larger  time  than  the  all-analog  if  state- 
of-the-art  ADCs  are  used.  The  serial-parallel  processor  time  will  be  con¬ 
siderably  smaller  than  the  all-analog  time  (for  a  basic  f  =  1  MHz) ,  but  it 
must  be  remembered  that  N  ADCs  would  be  necessary. 

3.4  MOS  Analog  Multiplier  Compatible  with  CCD  Structures 

The  implementation  of  the  analog  TSVIP  requires  on-chip  analog  multipliers 
and  op  amps.  The  CCD  structures  use  MOS  technology,  and  consequently  the 
design  of  the  chip  will  be  simplified  if  the  multipliers  and  op  amps  use  the 
same  technology.  Several  NMOS  high  performance  op  amps  have  been  reported 
in  the  literature,  [9]. 

A  four  quadrant  NMOS  analog  multiplier  which  seems  adequate  for  our 

application  was  designed  by  Bosshart,  [lo]  for  a  CCD  signal  processor.  The 

basic  structure  of  the  multiplier  is  given  in  Fig.  3.7.  The  transistors  are 

n  channel  MOS  enhancement  type  devices.  Recall  that  the  output  of  CCD  cells 

have  dc  bias  level,  and  the  inputs  to  the  multipliers  come  directly  from  CCD 

taps.  The  voltages  V  and  V  .  will  then  vary  with  the  signal  about  the  dc 

IN^  IN2 

bias  level,  but  will  never  become  negative.  and  are  biased  by  VDD»  vss  v 


and  ^j3^as  b°  work  in  the  saturation  region ,  acting  as  a  current  source 
and  Q1  as  a  source  follower.  Q3  and  must  work  in  the  "triode"  region 
(the  essentially  linear  region  before  saturation) ,  and  they  work  as  voltage 
controlled  resistors.  Their  VT  must  be  large.  If  the  busses  to  which  the 
sources  of  and  are  connected  are  at  a  potential  equal  to  the  dc  bias 
at  the  output  of  the  CCD  devices ,  the  V  for  these  two  transistors  will  be 
equal  to  because  the  output  voltage  of  is  practically  the  same  as 

its  input  voltage. 

For  and  the  drain  current  is  given  by 
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The  summation  of  I  and  (-1  )  is  then 

°4  °3 


I  -  I  =  BV  (V  -  V  ) 
D4  D3  in  IN2  ref 


(3.4.3) 


If  V  is  made  equal  to  the  dc  bias  level  of  V__.  ,  we  see  from  (3.4.3)  that 
ref  Ih_ 


(3.4.4) 


This  basic  multiplier  produces  distortion  terms  due  to  the  high  output 
impedance  of  the  CCD  devices  which  drive  Q  ,  the  output  impedance  of  Q^,  etc. 

It  is  possible  to  correct  these  errors  by  adding  extra  components  to  the 
circuit,  such  as  a  source  follower  between  the  output  of  the  CCD  and  the  gate 
of  Q  ,  or  the  error  terms  could  be  corrected,  as  suggested  in  QO ]  by  perform¬ 
ing  a  weighted  summation  of  1^  and  -I  .  The  only  way  of  checking  the  per- 

4  3 

formance  of  the  device  is  by  means  of  a  prototype,  although  an  extensive 
theoretical  analysis  taking  all  these  factors  into  consideration  could  be  per¬ 
formed.  For  a  channel  length  of  1.5  pm,  well  within  present  technology  limits. 


the  maximum  bandwidth  of  the  device  is  5  MHz 
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3.5  Experimental  Results  for  the  Multichip  Implementation  offP^l+ 

3.5.1  Introduction 

Although  the  eventual  goal  of  this  research  is  to  design  and  construct 
the  CCD  processor  in  a  single  chip  or,  if  this  is  not  possible,  in  a  minimum 
number  of  chips ,  it  was  desirable  at  this  time  to  test  the  feasibility  of 
the  CCD  implementation  by  constructing  one  of  the  TSVIP  blocks  using  commer¬ 
cially  available  CCD  devices,  multipliers  and  op  amps. 

•f 

With  reference  to  Fig.  3.2,  we  see  that  the  implementation  of  [P  ] 
requires  the  use  of  two  PISO  CCD  devices ,  two  SIPO  CCD  devices ,  four  analog 
multipliers,  and  two  summers.  The  use  of  commercially  available  CCD  devices 
plus  the  requirements  presented  by  variable  matrix  operations ,  resulted  in 
some  problems  which  can  be  easily  avoided  when  CCDs  are  used  to  implement 
transversal  filters  or  discrete  correlators. 

To  our  knowledge  only  EGSG  Reticon  produces  commercial  SIPO  and  PISO 
CCD  devices  at  present.  These  devices  have  an  output  dc  bias  level  of  about 
9.5  V  for  the  SIPO  and  5  V  for  the  PISO.  The  output  signal  appears  super¬ 
imposed  to  this  bias.  For  the  Reticon  TAD- 32  SIPO  device,  the  input  signal 
can  have  a  maximum  value  of  3  V  pp.  If  a  higher  amplitude  is  input,  the 
positive  swing  of  the  outputs  is  clipped,  due  to  the  dc  bias.  For  transversal 
filters  and  other  single  output  applications,  the  dc  bias  can  be  eliminated 
at  the  output  by  means  of  a  simple  resistor-difference  amplifier  circuit,  f 11 ] . 

For  our  application,  however,  in  which  the  N  outputs  have  to  be  used  individually, 
a  dc  bias  elimination  circuit  would  have  to  be  used  at  each  tap.  In  an  inte¬ 
grated  circuit  processor  this  would  not  be  a  difficult  requirement,  because 
only  a  few  transistors  and  resistors  with  values  convenient  for  integration 
are  needed.  If  discrete  components  are  involved,  as  in  our  experimental 
circuit,  the  resultant  circuit  would  be  too  bulky.  A  simple  approach,  not 
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convenient  in  practice,  was  used  in  our  circuit,  which  will  be  explained  in 
section  3-5.2. 

Another  problem  is  presented  by  noise  introduced  by  the  sampling  process. 
Observations  very  similar  to  those  made  above  apply  also  in  this  case.  In 
transversal  filters,  the  noise  can  be  filtered  once  at  the  output.  The 
sampling  noise  can  be  explained  graphically  by  means  of  Figs.  3.8(a)  and  (b) . 

In  Fig.  3.8(a),  the  lower  trace  is  a  sinusoidal  input  at  500  Hz,  sampled  at 
500  KHz.  The  upper  trace  is  the  output  at  tap  1.  The  noise  is  inherent  to 
the  sampled  operation  of  the  CCD  in  which  a  "piece"  of  the  input  is  transferred 
at  each  clock  pulse.  The  sweep  in  Fig.  3.8(a)  is  at  1  ms/div,  while  in 
Fig.  3.8(b)  the  same  two  signals  are  shown  with  the  sweep  at  .5  ps/div.  The 
notch  at  the  tap  *)1  output  is  due  to  the  sampling-holding-transferring  and 
shows  up  as  noise. 

3.5.2  Experimental  Circuit 

As  mentioned  in  the  previous  section,  the  experimental  circuit  was  con¬ 
structed  using  multiple  chips.  Four  vector  boards  were  used,  one  for  the 
PISO  circuit,  one  for  the  multipliers/adders  circuit,  one  for  the  SIPO  circuit, 
and  one  for  the  clocks.  The  PISO  devices  are  che  Reticon  R5501.  As  can  be 
seen  in  Fig.  3.9,  two  bias  voltages  are  required  for  thes<*  devices.  The  value 
of  the  bias  voltages  affects  the  maximum  allowable  peak  to  peak  value  of  the 
signal.  Bias  voltages  were  adjusted  for  optimal  operation.  The  R5501  requires 
three  clocks,  0^  and  which  are  the  complement  of  each  other  and  wnich  work 
at  the  frequency  of  transfer,  and  0^  which  works  at  the  leading  frequency. 

One  0T  pulse  is  required  for  every  32  0^  pulses,  because  the  device  nas  32 
parallel  inputs.  This  is  in  accordance  with  the  F  and  NF  frequencies  indicated 
in  Fig.  3.2.  In  a  custom  made  device  the  number  of  parallel  inputs  would  b.  N. 
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'igure  3*9  FISO  Devices  Circuit:  Diagram 


In  the  Reticon  device  loading  is  effected  when  0^  and  0 ^  are  high,  but  0 
must  start  at  least  50  ns  before  and  end  at  least  50  ns  after  the  correspond¬ 
ing  0^  pulse.  A  combination  logic  TTL  circuit  was  designed  to  obtain  0^,  0 
and  02  from  a  single  external  clock  signal.  The  signals  are  transferred 
entirely  out  of  the  CCD  device  during  the  next  32  clock  pulses  of  0^  and  0,  » 
when  0^  is  high  and  0 is  low.  The  sampled  signals  are  first  stored  in  the 
input  capacitors,  and  then  transferred  into  the  delay  line.  This  process  has 
an  effect  in  the  output,  as  will  be  seen  later. 

The  specified  maximum  frequency  for  the  R5501  is  5  MHz, [12] ,althouth  the 
performance  of  the  devices  degrades  quickly  for  f  >  2MHz.  Consequently,  NF 
was  chosen  to  be  1  MHz,  with  F  =  31.25  KHz.  This  is  well  below  the  frequency 
specified  in  the  previous  report,  but  it  is  the  best  achievable  with  available 
devices.  In  general  SIPO  devices  perform  better  than  PISO,  and  as  was 
suggested  in  Sect.  3.2,  it  could  be  more  convenient  to  use  SIPO  devices  only  in  the 
SOP  configuration  to  implement  the  processor.  The  lack  of  time  and  of  the 
required  parts  prevented  the  testing  of  this  architecture. 

The  SIPOs  used  in  the  experimental  circuit  also  present  the  problem  of 
sensitivity  to  bias  voltages,  and  these  were  adjusted  for  optimal  operation. 

The  circuit  for  the  SIPO  CCDs  is  given  in  Fig.  3.11. 

The  multiplier  chips  chosen  were  the  AD533,  with  a  maximum  error  of  less 
than  .5%  of  full  scale,  and  a  small  signal  unity  gain  of  1  MHz.  The  summers 
were  implemented  using  the  AD  507J  op  amp  which  has  a  100  MHz  G8W  product,  a 
25  V/us  minimum  slew  rate,  and  a  unity  gain  BW  of  more  than  10  MHz.  The  circuit 
is  given  in  Fig.  3.10. 

With  reference  to  Fig.  3.2,  we  see  that  the  dc  bias  at  the  output  of  the 
PISO  devices  must  be  blocked  before  the  signals  are  inputted  to  the  multipliers. 
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Figure  3«10  Multipliers  and  Summers  Circuit  Diagram 
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As  already  mentioned,  the  discrete  circuit  implementation  of  a  resistive  network/ 
differential  amplifier  circuit  would  be  too  cumbersome  for  this  purpose.  For 
this  qualitative  study,  a  simple  blocking  capacitor  was  used. 

In  order  to  test  the  devices  qualitatively,  a  staircase  voltage  from 
-0.22  V  to  -e.O  V  in  steps  of  0.22  V  was  applied  to  taps  1  through  9  of  the 
PISO  device  No  1,  and  a  staircase  from  -2  V  to  -0.22  V  to  the  PISO  device  No  2 
taps  1  to  9.  With  reference  again  to  Fig.  3.2,  q  was  chosen  as  2  V  dc,  q^2 
as  1.5  V  dc  and  q  as  1  V  dc.  The  input  voltages  to  the  first  nine  taps  of 
the  PISO  devices  can  be  expressed  as  follows, 

=  -mx  ( 3 . 5 . 2 . 1 ) 

V2  =  -2  +  mx  (3. 5. 2. 2) 


where  m  =  2/9  is  the  ramp  slope  and  x  is  the  tap  number.  Multiplication  by  the 
constant  ’q"  inputs  o  the  multipliers  only  changes  the  scaling  of  these 
voltages,  and  addition  of  the  multipliers  outputs  produces  another  straight 
line  staircase , 


+  V 


-m  x  -  K  +  m^x 


=  -K  +  (m0  -  m^)x 


(3. 5. 2. 3) 


Waveforms  for  the  experimental  circuit  are  shown  in  Figs.  3.12  to  3.14. 

In  Fig.  3.12(a),  the  upper  trace  shows  the  f3  clock  pulse.  The  lower  trace 
shows  a  few  0^  clock  pulses.  The  time  relation  between  0^  and  0^  shows  clearly. 
Fig.  3.12(b)  shows  the  output  of  PISO  device  No  J .  This  waveform  corresponds 
to  expression  (3. 5. 2.1).  The  split  of  each  of  the  nine  steps  into  two  levels 
is  inherent  to  the  operation  of  the  R5501,  and  is  due  to  the  two  step  storage- 
transfer  operation  for  0^  high  and  0^  high,  respectively.  The  output  of  the 
multipliers  should  be  filtered  in  uhe  final  version  of  the  processor,  in  order 
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Fig.  3.12(b)  0m  Clock  And  Output  Of  P1SO  Device  No  1. 
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Fig.  3.14(a)  Output  Of  Summers 


Fig.  3.14(b)  SIPO  Devices  Output  At  Taps  No  9 
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to  avoid  higher  noise  and  distortion  in  successive  stages.  Fig.  3.13(a) 
shows  the  outputs  of  PI SO  devices  1  and  2  (upper  and  lower  traces,  respectively). 
Fig.  3.13(b)  shows  the  output  of  the  first  two  multipliers  of  Fig  3.2.  At 
this  point  noise  becomes  more  evident  due  to  the  two  different  levels  for  each 
output  pulse  of  the  PISO  devices.  The  waveforms  have  the  correct  shape, 
however. 

Noise  and  distortion  increase  significantly  at  the  output  of  the  summers, 
Fig.  3.14(a).  In  addition  to  the  sources  of  noise  mentioned  above,  the  use  of 
several  boards  introduces  grounding  problems  which  would  be  eliminated  in  an 
improved  version  or  in  a  single  chip  design  of  the  device.  Finally,  in  Fig. 
3.14(b)  which  shows  the  output  at  tap  9  of  the  SIPO  devices,  although  the 
general  shape  of  the  expected  signal  is  preserved,  noise  and  distortion  have 
increased  further. 

In  spite  of  the  high  noise  and  distortion  levels,  this  experimental 
version  of  the  pseudo  inverse  [P^]*  block  succeeded  in  showing  that  it  is 
possible  to  implement  the  TSVIP  by  means  of  CCD  devices  and  other  analog  devices. 

3.5.3  Conclusions  and  Recommendations 

The  main  sources  of  error  in  the  implemented  block  are : 

(a)  Coupling  capacitors  which  change  the  dc  level  at  the  input  to  the  multipliers 
by  an  amount  corresponding  to  the  average  value  of  the  ac  signal. 

(b)  Noise  due  to  sampling-storage-transfer  in  the  CCD  devices. 

(c)  Ground  problems  due  to  the  multi -board  implementation,  multiple  power 
supplies  and  the  necessity  of  three  clocks. 

This  was  a  simple  experimental  version  of  the  subsystem  using  readily 
available  components  and  many  discrete  parts  (resistors,  capacitors,  etc.). 

Noise  and  distortion  could  be  drastically  reduced  in  a  system  using  specially 
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designed  CCD  devices  and  a  high  degree  of  integration.  The  use  of  SOP  archi¬ 
tecture  which  allows  implementation  using  only  SIPO  devices  (plus  multipliers) 
should  be  considered,  due  to  the  higher  performance  of  SIPO  devices. 

The  Reticon  devices  are  surface  charge  devices.  The  design  should  be 
based  on  buried  channel  ("peristaltic")  devices,  which  do  not  need  a  "fat 
zero"  (i.e.,  an  input  dc  bias  level)  and  have  higher  speeds,  better  charge 
transfer  efficiency  and  a  larger  dynamic  range  than  surface  channel  devices 
[13.14]. 
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CHAPTER  IV 

THE  USE  OF  SEQUENTIAL  ESTU'ATION  TECHNIQUES 
IN  IMPLEMENTING  THE  TS’  IP  ALGORITHM 

4.1  Introc action 

4.1.1  Background 

The  TSVIP  algorithm  reduces  the  problem  of  image  “-racking  to  a  problem  in 
linear  estimation  [5] .  The  method  by  which  this  linear  estimation  is  performed 
determines  the  speed  and  ease  with  which  tie  TSVIP  algorithm  can  be  implemented. 
A  linear  estimation  procedure  which  can  be  performed  rapidly,  but  is  difficult 
or  impossible  to  implement  with  the  desired  circuit  technology  is  usciess. 
Likewise,  an  estimation  procedure  wh’ch  lends  itself  to  easy  implementation 
with  the  desired  technology,  but  is  temporally  inefficient  is  also  of  no  use. 

Charge  coupled  devices  (CCDs)  are  the  devices  with  which  it  is  desired 
to  implement  the  tracking  processor.  As  pointed  out  elsewhere  in  the  report, 
CCDs  have  been  selected  because  of  their  size,  low  power  consumption,  reli¬ 
ability  and  speed  [14].  It  is  anticipated  that  an  entire  image  tracker  includ¬ 
ing  a  CCD  imager  could  be  constructed  on  one  VLSI  integrated  circuit.  While  a 
clock  rate  of  from  1  to  50  IlHz  would  be  sufficient  for  a  tracking  processor, 
using  the  solution  approach  discussed  in  this  chapter,  experinental  CCDs  have 
been  clocked  at  up  to  1  Gnz.  Results  of  this  sort  certainly  make  it  desirable 
to  find  a  linear  estimation  procedure  which  lends  itself  to  easy  implementation 
with  CCDs. 

4.1.2  Closed  Form  Techniques 

Two  estimation  procedures  which  meet  the  first  criterion  of  speed  are  the 
matrix  inverse  and  the  generalized  inverse  applied  to  square  and  over determined 
systems,  respectively  [151.  The  matrix  inverse  provides  an  estimate  with  no 
associated  error,  while  the  generalized  inverse  provides  an  estimate  whose 
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associated  total  squared  error  is  minimized.  The  matrix  inverse  is  of  little 
use  since  only  overdetermined  systems  are  anticipated.  The  main  drawback 
of  these  techniques  is  that  both  require  a  matrix  inversion  which  is 
difficult  if  not  impossible  to  perform  totally  with  CCDs  (multipliers  may  be 
required).  Therefore,  it  is  necessary  to  look  beyond  these  closed-form 
procedures  for  a  suitable  estimation  procedure. 

4.1.3  Sequential  Procedures 

Sequential  procedures  are  a  class  of  estimation  procedures  which  satisfy 
the  second  of  the  aforementioned  criteria.  They  call  for  just  the  sort  of 
linear  combinations  of  discrete-analog  sequences  that  CCDs  are  able  to  provide. 
This  makes  sequential  estimation  procedures  better  suited  to  CCDs  than  the 
closed  form  procedures . 

A  sequential  estimation  algorithm  is  a  recursive  procedure  which,  using 
an  initial  "guess,"  converges  to  a  solution  of  a  system  of  a  linear  equations 
which  minimizes  a  chosen  criterion  function.  Most  often  the  total  squared 
error  associated  with  the  estimate  is  chosen  for  the  criterion  function. 
Sequential  estimation  procedures  which  minimize  a  squared-error  criterion 
function  can  be  shown  to  converge  to  the  same  solution  as  the  generalized 
inverse  as  the  number  of  recursions  performed  becomes  infinite  .  For  practical 
reasons,  recursion  is  terminated  after  a  reasonably  accurate  solution  has  been 
obtained.  The  usefulness  of  a  sequential  procedure  is  severely  limited  if  a 
large  number  of  recursions  is  required  to  arrive  at  an  acceptable  estimate  of 
the  solution  to  a  system  of  linear  equations.  A  judicious  choice  of  the 
starting  "guess"  and  the  use  of  convergence  acceleration  techniques  (to  be 
subsequently  discussed)  can  be  of  some  help.  However,  the  utility  of  sequential 
estimation  procedures  in  implementing  the  TSVIP  algorithm  is  extremely  dependent 
on  the  speed  with  which  the  procedures  converge . 
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4.2  Minimum  Squared-Error  Descent  Procedures 
4.2.1  Introduction 

The  sequential  estimation  techniques  chosen  for  investigation  are  known 
as  minimum  squared-error  descent  procedures.  These  sequential  estimation  pro¬ 
cedures  use  the  gradient  descent  method  to  minimize  the  squared-error  associated 
with  the  solution.  Their  suitability  for  CCD  implementation  makes  them 
attractive  for  use  in  a  target  tracking  processor. 

The  problem  which  must  be  solved  is 

&  =  Da  (4. 2. 1.1) 

where 

d  is  the  N  x  1  scene  difference  vector, 

D  is  the  N  x  6  matrix  of  weighted  and  unweighted  spatial  derivatives , 

a  is  the  6x1  vector  of  the  affine  transform  coefficients  (the  quantity 
it  is  desired  to  estimate) ,  and  N  is  the  number  of  target  points  used  in  the 
tracking  calculat;  -.n. 

An  estimate  of  the  a  vector  which  minimizes  some  function  of  the  error 
between  Da  and  d  is  sought.  An  error  vector  can  be  defined  as 

e  =  Da  -  d  (4.2. 1.2) 

The  square  of  the  total  length  of  the  error  vector  is  then  given  by 


J (a)  =  | [Da  -  dj  | 


k 


k-1 


(4. 2. 1.3) 


where 

k  th 

D  is  the  transpose  of  the  k'  row  of  the  D  matrix, 

J.  £ 

d‘  is  the  k'  element  of  the  d  vector, 
t 

a  is  the  transpose  of  the  affine  transform  coefficient  vector. 
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it  is  this  function  which  we  wish  to  minimize  in  obtaining  a  "good" 
estimate  of  the  vector  a.  A  gradient  descent  procedure  can  be  used  to  produce 
a  sequence  of  vectors  which  will  eventually  converge  to  a  solution  minimizing 
J(a).  The  form  of  a  general  gradient  descent  (also  known  as  steepest  descent) 
is  given  by 

Vl  =  ak  -  pkVJ(ak)  (4. 2. 1.4) 

whe  re 

and  a^^represent  the  k,t-1  and  k+l'tk  estimate  of  a,  respectively, 
p^  is  a  positive  scale  factor  which  adjusts  the  step  size  [16]. 

The  initial  estimate  a^  is  chosen  arbitrarily  unless  a  priori  information  is 
available  to  provide  a  reasonable  guess.  At  each  iteration  of  the  descent 
procedure  a  fraction  of  the  error  gradient  is  subtracted  from  the  previous 
estimate  of  a.  If  a^  is  thought  of  as  a  point  in  the  multi-dimensional  a  vector 
space ,  then  the  subtraction  of  a  fraction  of  the  error  gradient  represents  a 
movement,  in  the  vector  space,  in  the  direction  of  the  maximum  decrease  in  the 
magnitude  of  the  chosen  error  criterion.  Thus,  each  step  is  thought  of  as  a 
downward  movement  in  the  direction  of  the  location  of  the  a  vector  which 
minimizes  J  (a) .  Thus,  the  name  "descent  procedure." 

4.2.2  Multi-Sample  Ainorithm 

In  this  case  the  gradient  of  the  criterion  function  J (a)  is  given  by 

N 

J (a)  =  y  2(atDk  -  dk)Dk  =  2Dt(Da  -  d)  (4. 2. 2.1) 

k=l 

Inserting  this  result  into  equation  (4. 2. 1.4)  gives  the  descent  algorithm 

a,  =  a,  -  r>  Dt(Da,  -  d)  (4.2. 2.2) 

k+1  k  *  k  k 

It  can  be  shown  that  if  p^  is  chosen  to  be  p^/k ,  where  p^  is  a  constant 
usually  less  than  1,  this  descent  ,orithm,  which  will  be  called  the  multi¬ 


sample  algorithm,  satisfies 
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Dt(Da  -  d)  =  0  (4.2.2. 3) 

Thus,  this  descent  algorithm  will  determine  a  coefficient  vector  a  which 
minimizes  the  total-squared  length  of  the  error  vector. 

An  algorithm  of  this  sort  does  fulfill  the  requirement  of  not  requiring  a 
matrix  inversion.  The  multi-sample  algorithm  also  satisfies  the  speed  of  con- 
\argence  requirement  previously  discussed.  Its  main  drawback  is  that  its  CCD 
implementation,  while  not  impossible,  would  be  very  hardware  intensive.  The 
size  of  the  D  matrix,  N,  would  determine  the  number  of  tapped  delay  lines 
{the  basic  CCD  'builaing  block")  required  to  implement  this  algorithm.  Thus, 
the  number  of  target  points  used  in  tracking  would  determine  the  size  of  the 
processor.  This  is  not  desirable  and  necessitates  looking  further  for  a  more 
suitable  version  of  the  descent  procedure. 

4.2.3  The  Widrow-Hoff  Rule 

The  error  criterion  used  in  arriving  at  the  multi-sample  descent  algorithm 
represents,  except  for  a  constant  multiplier,  the  average  squared  length  of 
the  error  vector  associated  with  estimate  a^.  The  movement  at  each  iteration 
is  in  the  direction  of  the  maximum  decrease  in  the  average  length  of  the 
squared  error  vector.  Widrow  and  Hof :  [17)  introduced  the  idea  of  substituting 
individual  error  vectors  for  the  average  errcr  vector.  This  allows  the  rows 
of  the  D  matrix  to  be  considered  individually  and  leads  to  the  LMS  or  Widrow- 
Hoff  Rule 

a.  .  =  a.  +  p  (dk  -  afok)Dk  (4.2. 3.1) 

k+ 1  k  k  k 

This  descent  procedure  allows  the  rows  of  the  D  matrix  to  be  considered 
sequentially.  If  p^  is  taken  as  p^/k,  p^  a  constant,  the  Widrow-Hoff  Rule  will 
tend  towards  a  solution  which  minimizes  the  squared-error  in  the  estimate  of 
a^_.  Moreover,  the  CCD  implementation  of  the  Widrow-Hoff  Rule  need  consist  of 


only  one  tapped  delay  line  with  associated  multipliers,  summers  and  steering 
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logic  [18,19].  A  block  diagram  representation  of  a  possible  CCD  implementation 
is  shown  in  Fig.  4.1.  The  multipliers  summers,  and  logic  necessary  to  complete 
the  circuit  could  be  implemented  on  the  same  substrate  as  the  tapped  delay  line. 
The  tradeoff  one  must  make  for  these  advantages  over  the  multi-sample  algorithm 
is  a  reduced  speed  of  convergence.  The  averaging  of  the  error  gradients  used 
in  the  multi-sample  descent  algorithm  serves  to  "smooth"  the  error  gradients 
and  reduce  the  effect  of  bad  data,  i.e.,  those  individual  error  gradients 
which,  because  of  noise  or  other  random  effects,  do  not  represent  a  move 
towards  the  minimum  of  the  criterion  function.  The  Widrow- Hoff  Rule  discards 
this  averaging  and  thus  follows  a  less  direct  path  to  the  minimum  of  the 
criterion  function.  This  leads  to  red>wed  speed  of  convergence. 

4.2.4  Convergence  Acceleration 

Iteration  speedup  techniques  can  be  used  to  increase  the  rate  of  conver¬ 
gence  of  the  Widrow-Hoff  Rule  [20).  A  very  effective  method  of  accelerating 
its  convergence  is  to  hold  p  constant  as  long  as  the  error  term, 

(dk  -  a>k)  (4. 2. 4.1) 

K 

maintains  a  constant  sign.  The  reasoning  behind  this  is  as  follows.  When  the 
search  for  the  minimum  of  the  error  criterion  is  far  from  that  minimum  large 
steps  at  each  iteration  are  desirable.  As  long  as  the  sign  of  the  error  term 
is  constant  it  is  assumed  that  the  search  is  far  from  the  minimum,  Pj_  is  held 
constant  and  the  steps  stay  the  same  size.  When  the  error  term  changes  sign 
this  is  an  indication  that  the  search  has  reached  the  vicinity  of  the  sought 
for  minimum.  A  smaller  step  size  is  then  desirable  to  allow  the  search  to 
converge  more  easily  to  the  iocation  of  the  a  vector  whose  associated  squared 
error  is  minimized.  This  is  analogous  to  slowing  down  one's  automobile  so  as 
to  not  pass  by  one's  destination  as  it  is  neared. 


( 


0 


4.2.5  Startup 

The  scene-to-scene  temporal  dependence  required  by  the  TSVI?  algorithm 
provides  another  reason  to  be  optimistic  about  the  applicability  of  sequential 
descent  algorithms  to  its  solution.  3oth  sequential  methods  presented,  the 
multi-sample  and  Widrow-Hoff  rules,  require  a  starting  "guess''  of  a.^.  Without 
a  priori  information  this  is  often  chosen  as  0.  A  more  logical  starting  point, 
in  this  case,  is  simply  the  estimate  arrived  at  for  the  previous  camera  frame. 
The  assumption  of  fast  temporal  sampling  required  for  the  relevance  of  the 
TSVIP  algorithm  means  that  from  frame  to  frame  the  target  will  appear  to  have 
a  slowly  changing  velocity.  This  implies  that  the  best  "guess"  for  the  present 
target  movement  is  simply  the  previous  estimated  target  movement.  Using  the 
previous  target  movement  as  the  starting  point  for  the  next  set  of  iterations 
provides  a  starting  point,  in  the  a  vector  space,  which  can  be  logically 
assumed  to  be  near  to  the  location  which  minimizes  the  sauared-erro’-  associated 
with  the  estimate  a,  .  Since  this  allows  the  search  to  start  closer  to  the 
minimum,  the  rate  of  convergence  will  be  significantly  accelerated. 


4.3  Simulation 


4.3.1  Introduction 


A  computer  simulation  was  performed  to  ascertain  whether  the  speed  of  con¬ 
vergence  of  the  Widrow-Hoff  Rule  was  sufficient  to  allow  its  use  in  implement¬ 
ing  the  TSVI?  algorithm.  Simulation,  while  not  as  realistic  as  the  use  of 
actual  scene  data,  makes  for  easy  confirmation  of  the  properties  of  the  algorithm. 
3y  varying  one  parameter,  such  as  the  convergence  constant  p^ ,  while  holding 
the  rest  constant,  the  effect  of  each  parameter  on  the  performance  of  the 
algorithm  can  be  determined. 

The  simulated  scene  formulation  is  as  found  in  [5].  The  target  textural 


function  is  civen  as 
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rt.  siniA  1  sin (iA/2 .5) 

fU,j)  - IT-  — ijvTsT  *  -3:|1+2 


(4. 3. 1.1) 


where  A,  the  sampling  interval,  is  taken  as  .2.  The  target  is  taken  as  a 
square  16A  x  16A,  i.e.,  16  pixels  square.  A  flow  chart  of  the  Widrow-Hoff  Rule 
implementation  is  shown  in  Fig.  4.2.  The  details  of  the  simulated  scene  setup 
and  those  operations  required  to  arrive  at  the  linear  system  necessary  for  use 
of  the  Widrow-Hoff  Rule  can  be  found  in  [5]. 


4.3.2  Convergence  Acceleration 

The  convergence  acceleration  technique  used  is  a  slight  modification  of 
the  previously  menu,  oned  technique.  The  conventional  technique  is  to  use  p^  = 
P0A  where  pQ  is  a  constant  and  k  is  an  integer  index  which  is  one  initially 
and  inc.emented  by  one  each  time  the  error  term  of  the  Widrow-Hoff  Rule  changes 
sign.  The  rationale  behind  this  rule  was  previously  stated.  In  simulation 
it  was  found  that  the  convergence  acceleration  provided  by  this  technique  was 
not  sufficient.  Therefore  the  technique  was  modified  by  incrementing  k  only 
after  a  fixed  number  of  error  term  sign  changes,  usually  from  three  to  five.  It 
was  found  that  very  little  if  any  further  acceleration  was  provided  beyond 
five  sign  changes.  In  this  manner  p^  did  not  decrease  as  ^_pidly  and  the  step 
sizes,  in  the  search  for  the  optimum  a  vector,  did  not  decrease  as  rapidly 
when  compared  to  the  step  sizes  produced  with  the  conventional  acceleration 
procedure.  Through  the  use  of  this  modified  acceleration  technique,  the  con¬ 
vergence  of  the  Widrow-Hoff  Rule  could  be  accelerated  by  from  20  to  35%. 

4.3.3  Size  of  Perturbation 

Tho  first  property  investigated  was  the  effect  of  increasingly  larger 
target  perturbations  on  the  accuracy  and  rate  of  convergence  c£  the  Widrow-Hoff 
procedure.  Target  movements  of  .05,  .08,  .1,  and  .2  were  used.  These  represent 
movements  of  one-fourth,  two-fifths,  one-half,  and  one  pixel,  respectively. 


Obtain  D  matrix,  a  vector,  initial  a  vector,  ?q, 
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Figure  4.2 


rlowcnart  of  Inolementation  of  .Jidrow-doff  Rule 


The  results  of  these  simulated  movements  are  summarized  in  Figs.  4. 3-4.6. 

The  curves  with  a  subscript  of  one  indicate  simulations  in  which  the  starting 
point  was  selected  as  zero.  Those  curves  subscripted  two  indicate  simulations 
in  which  a  starting  point  which  was  from  ten  to  twenty  percent  different  from 
the  actual  target  perturbation  was  selected. 

One  can  see  at  once  that  the  Taylor  series  approximation  begins  to  become 
invalid  as  the  size  of  the  target  perturbation  increases.  While  the  estimate 
of  the  B (1)  element  of  the  translational  vector  remains  accurate  through  the 
range  of  perturbations,  the  estimate  of  the  B(2)  element  falls  from  95% 
accuracy  for  a  perturbation  of  .05  to  80%  accuracy  for  a  perturbation  of  .2. 

For  larger  target  perturbations  than  those  shown,  the  B(l)  element  also  falls 
off  in  accuracy.  This  condition  of  more  degradation  of  the  B(2)  element  of 
the  translational  vector  than  of  the  B(l)  element,  for  increasing  target  pertur¬ 
bation,  is  a  function  of  the  target  textural  function  which  is  non-symmetrical 
in  the  B(l)  and  B(2)  directions.  The  basic  spatial  frequency  of  the  textural 
function  in  the  B(2)  direction  is  two  and  one-half  times  that  in  tne  B ( 1 ) 
direction.  Thus,  any  attempt  to  express  it  in  a  truncated  series  must  suffer 
from  more  truncation  error  than  a  similar  expansion  of  the  textural  function 
in  the  B(l)  direction. 

Figures  4.3  -  4.6  also  provide  valuable  information  about  the  selection 
of  the  initial  convergence  constant  p  .  In  obtaining  these  curves,  an  attempt 
was  made  to  use  the  largest  p^  po:  ;ible  while  avoiding  overshoot.  Choosing  p^ 
too  small  resulted  in  extremely  slow  convergence  of  the  algorithm.  Conversely, 
choosing  p^  too  large  resulted  in  an  oscillatory  overshoot  which  also  caused 
a  slowing  of  convergence.  The  important  finding  is  that  the  optimum  p^  in¬ 
creased  as  the  target  perturbation  was  increased.  Thus,  for  optimum  convergence 
p  cannot  be  chosen  as  a  constant  but  must  be  adjusted  from  frame  to  frame. 
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Since  it  is  impossible  to  know  a  priori  the  magnitude  of  the  target  movement 
whicn  is  being  estimated,  the  previous  target  movement  is  the  best  value  on 
which  to  base  a  choice  of  p  .  The  assumption  of  fast  temporal  sampling  inherent 
in  the  TSVIP  algorithm,  should  make  this  a  reasonable  assumption.  In  any  case 
the  choice  of  pQ  should  be  conservative  to  avoid  any  chance  of  overshoot  or 
instability  in  the  estimation  process. 

For  completeness,  a  simulation  which  includes  target  dilation  and  rotation 
is  summarized  in  Fig.  4.7.  For  small  perturbations  the  estimates  of  both 
dilation  and  rotation  were  found  to  be  accurate  and  to  converge  quite  rapidly. 

A  more  exhaustive  investigation  was  not  carried  out  because  dilation  and 
rotation  are  not  of  primary  interest  in  this  investigation.  That  is,  in  a 
tracking  processor,  they  are  of  secondary  interest  to  the  target  translational 
parameters.  Additional  work  will  be  required  if  they  are  needed  for  control 
purposes . 

4.3.4  Startup 

As  was  stated  in  the  derivation  of  gradient  descent  procedures,  a  start¬ 
ing  "guess  '  is  necessary  to  compute  an  initial  error  gradient.  The  claim  was 
made  that  the  previous  target  translation  was  a  good  candidate  for  this  start¬ 
ing  point  as  the  scene-to-scene  temporal  dependence  inherent  in  the  TSVIP 
algorithm  guaranteed  small  changes  in  target  velocity  from  frame  to  frame.  To 
verify  this  claim  the  four  increasingly  larger  target  perturbations  of  Figs. 

4.3  -  4.6  were  run  with  starting  points  of  from  ten  to  twenty  percent  difference 
from  the  actual  perturbation.  The  reduction  in  the  number  of  iterations 
required  for  convergence  ranged  from  20  to  50'5-.  The  larger  target  perturba¬ 
tions  benefitted  more  than  the  smaller  from  this  choice  of  a  startup  point. 

The  results  indicate  that  an  intelligent  choice  of  the  startup  point  for  the 
Widrow-Hoff  Ruie  can  produce  significant  savings  in  the  number  of  iterations 
required  for  convergence. 


4-3-5  Noise  Susceptibility 


The  previously  discussed  simulations  were  performed  using  exact  spatial 
derivatives  obtained  from  the  target  textural  function  and  used  no  additive 
noise.  To  investigate  the  behavior  of  the  Widrow-Hoff  Rule  in  implementing 
the  TSVIP  algorithm  using  noise  corrupted  scene  data  the  positive  half  of  a 
normally  distributed,  zero  mean  noise  process  was  added  to  the  simulated  scene. 
The  spatial  derivatives  necessary  to  form  the  system  of  linear  equations  pro¬ 
vided  by  the  TSYI?  algorithm  were  performed  using  a  simple  difference  equation. 
The  results  are  displayed  in  Fig.  4.S.  The  addition  of  noise  to  the  scene 
produced  rather  unreliable  estimates  of  the  target  perturbation.  The  estimation 
of  spatial  derivatives  in  a  noisy  environment  is  known  to  be  unreliable  .  The 
error  associated  with  additive  scene  noise  can  be  attributed  to  this  unreli¬ 
ability.  The  use  of  a  3  x  3  window  to  introduce  some  averaging  into  the 
spatial  derivatives  failed  to  produce  any  significant  improvement  in  the  results 


4 . 3 . f.  Summation 

The  main  conclusions  resulting  from  the  preceding  tracking  simulations  are 
as  followoi 

1.  Larger  target  perturbations  produce  wors  translational  estimates  than 
smaller  perturbations  due  to  the  increasing  truncation  error  inherent  in  a 
Taylor  series  approximation. 


To  achieve  the  same  rate  of  convergence  for  larger  target  perturbations 


as  for  smaller  requires  an  increase  in  the  initial  convergence  constant. 


3.  An  intelligent  choice  of  the  starting  "guess’’  in  the  Widrow-Hoff 
Kuie ,  utilizing  a  priori  information,  can  significantly  improve  the  rate  of 


converge.,  -e . 

4.  The  estimation  of  spatial  derivatives  in  a  noisy  environment  introduces 
significant  error  into  the  estimated  target  translational  parameters  provided 


by  the  Widrow-Hoff  Rule. 

5.  The  results  of  these  simulations  are  encouraging  enough  to  recommend 
that  the  Widrow-Hoff  Pule  be  tried  in  an  implementation  of  the  TSVIP  algorithm 
using  actual  video  data. 

4.4  Conclusions  and  Recommendations  for  Future  Study 

The  use  of  a  particular  sequential  estimation  procedure,  the  Widrow-Hoff 
Rule,  has  been  applied  to  the  implementation  of  the  TSVIP  tracking  algorithm. 
For  small  perturbations  and  no  additive  scene  noise,  this  estimation  procedure 
has  been  shown  to  be  effective  in  simulation-  The  use  of  a  priori  information 
and  a  slightly  modified  convergence  acceleration  procedure  result  in  the  con¬ 
vergence  of  the  Widrow-Hoff  Rule  in  an  acceptably  small  number  of  iterations. 
The  addition  of  noise  to  the  simulated  scene  results  in  a  significant  degrada¬ 
tion  of  the  performance  of  the  estimation  procedure-  This  is  a  cause  for  some 
pessimism  over  the  usefulness  of  the  Widrow-Hoff  Rule  in  the  implementation 
of  the  TSVIP  algorithm. 

Future  study  will  mainly  involve  obtaining  actual  scene  data  from  an 
imaging  device.  It  is  hoped  that  the  use  of  strict  segmentation  measures  in 
defining  target  points  will  yield  a  system  of  linear  equations  which  is  well 
behaved,  i.e.,  will  yield  accurate  estimates  when  operated  on  by  the  TSVIP 
algorithm. 


CHAPTER  V 


OTHER  ALGORITHMS 

5.1  Introduction 

5.1.1  Purpose 

This  section  reports  on  an  investigation  into  the  other  algorithms 
for  image  tracking.  Although  the  TSVI?  algorithm  appears  to  be  the  most 
promising,  an  investigation  into  other  algorithms  is  necessary  for  several 
reasons.  First,  should  the  TSVI?  approach  prove  to  be  ineffective,  a  list 
of  possible  alternatives  would  have  been  studied.  Second,  although  the 
TSVI?  method  may  work  well  as  long  as  the  target  remains  locked  within  the 
field  of  view,  the  overall  system  performance  may  require  a  hierarchy  of 
algorithms  which  will  be  used  in  support  of  the  TSVI?  algorithm.  For  example 
algorithms  which  can  segment  the  target  from  the  background,  and  ones  which 
can  locate  and  be  used  to  lock  the  target  within  the  field  of  view,  may  be 
required  in  some  applications.  Finally,  alternative  algorithms  can  serve 
as  a  basis  of  comparison  to  show  ho*  well  the  TSVI?  algorithm  performs. 

Thus,  the  general  nature  of  tnis  investigation  is  to  discover  image  process¬ 
ing  techniques  which  can  either  support  or  replace  the  TSVI?  algorithm. 

5.1.2  Constraints 

There  are  several  constraints  on  the  algorithms  that  can  be  considered. 
These  constraints  are  related  to  special  performance  and  hardware  require¬ 
ments  for  the  expected  range  of  applications.  The  algorithms  will  be 
expected  to  perform  in  a  real-time  closed-loop  system,  and  they  must  provide 
adequate  iock-in  and  tracking  performance  at  extremely  h i oh  data  rates.  Thus 
the  algorithms  themselves  need  to  be  very  efficient;  that  is,  both  fast  and 


There  are  also  several  constraints  on  the  type  of  hardware  that  can  be 
implemented.  The  hardware  will  be  subjected  to  large  forces,  will  need  to 
fit  in  small  places ,  will  probably  be  powered  by  a  small  power  source ,  and 
will  process  data  at  a  high  rate.  Therefore,  the  technology  used  must  provide 
hardware  that  will  be  rugged,  small,  lightweight,  low  powered,  and  fasc. 

The  appropriate  choice  appears  to  be  CCD  based  discrete  analog  processing, 
a  conclusion  reached  in  the  previous  algorithm  work. 

In  CCD  based  image  processing  the  analog  signal  is  sampled  at  discrete 
intervals  in  time  and  space  and  processed  as  a  discrete  analog  signal.  As 
shown  in  a  previous  section,  CCD  devices  can  perform  complex  signal  process¬ 
ing  operations  at  high  data  rates  while  retaining  a  small  size  with  low 
power  consumption.  But  more  importantly,  the  operations  it  performs  are 
adaptive.  That  is,  the  filter  transfer  function  can  be  altered  in  response 
to  the  data  it  receives.  This  allows  a  flexible  and  powerful  hardware 
structure  where  the  same  basic  elements  can  be  used  to  perform  different 
functions. 

From  the  above  discussion  it  is  apparent  that  the  algorithm  search 
needs  to  be  limited  to  those  algorithms  that  can  take  advantage  of  CCD 
based  structures.  More  explicitly,  the  bulk  of  the  high  speed  processing 
should  be  performed  with  discrete  analog  technology  implemented  with  CCDs, 
while  !:he  slower  and  simpler  processing  may  use  both  digital  and  analog 
technologies.  This  hybrid  of  technologies  will  help  to  ensure  high  data 
processing  rates,  ruggedness,  low  power,  small  size,  and  low  weight. 

Constraining  the  hardware  to  be  based  largely  on  discrete  analog  pro¬ 
cessing  unfortunately  creates  a  constraint  on  the  kinds  of  algorithms  that 
can  be  investigated.  There  is  basically  one  operation  that  is  ideal  for 
discrete  analog  processing,  and  any  algorithm  that  can  be  considered  in 
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this  investigation  should  use  this  operation  extensively.  This  operation 
is  given  mathematically  as 

N-l 

y(k)  =  l  a(k,i)x(k-i)  (5. 1.2.1) 

i=0 

where  y(k)  is  the  discrete  analog  output  at  time  k,  x(k)  is  the  discrete 
analog  input  at  time  k,  and  a(k,i)  is  the  i  ‘  coefficient  for  the  operation 
at  time  k.  Notice  that  the  output  is  simply  a  weighted  sum  of  delayed  input 
values.  It  is  often  referred  to  as  a  transversal  filter,  a  moving  average 
filter,  or  a  finite  impulse  response  filter. 

By  the  appropriate  choice  of  the  time  varying  coefficients,  this  simple 
operation  can  perform  a  large  number  of  functions  in  addition  to  filtering, 
such  as  estimating  autocorrelations,  estimating  means  and  first  order  moments, 
estimating  gradients,  convolving  with  time  variant  responses,  matched 
filtering,  and  discrete  Fourier  and  other  orthogonal  transforms.  Also  by 
simply  feeding  the  output  back  into  the  input  a  more  general  filtering 
operation  is  obtained.  This  general  operation  is  often  referred  to  as  a 
recursive  filter,  an  autoregressive  filter,  or  an  infinite  impulse  response 
filter.  This  basic  operation  as  it  applies  to  each  algorithm  under  investi¬ 
gation  will  be  developed  in  later  sections. 

In  summary,  the  major  constraint  on  any  algorithm  being  investigated 
is  that  it  must  use  this  fundamental  operation  as  the  basis  of  its  process¬ 
ing  algorithm.  This  constraint  will  ensure  fast  processing,  small  size, 
low  weight,  low  power  consumption,  and  ruggedness. 

5.1.3  Assumptions 

As  with  any  initial  investigation,  certain  assumptions  must  be  made 
about  the  data  available  at  the  input  for  processing  and  the  type  of  data 
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needed  at  the  output  to  generate  the  appropriate  control  signals.  Specific 
assumptions  about  the  input  data  imposed  by  the  nature  of  the  target,  back¬ 
ground,  and  noise  will  be  referred  to  in  the  description  of  individual 
algorithms,  since  these  assumptions  are  algorithm  dependent.  However,  there 
are  several  general  assumptions  that  can  be  made  about  all  the  algorithms. 

The  expected  range  of  sampling  rates  of  the  input  data  must  be  deter¬ 
mined.  The  spatial  sampling  of  any  scene  is  dependent  on  the  zoom  capa¬ 
bilities  of  the  imager  and  on  the  number  of  pixels  in  each  frame.  It  will 

be  assumed  that  each  frame  of  the  raw  data  will  consist  of  an  array  100  x 

100  pixels  in  size  (although  this  is  not  a  limiting  assumption)  with  no 
assumptions  made  about  the  zoom  capabilities  of  the  imager.  Assumptions 
about  the  time  sampling  are  needed  to  specify  the  number  of  frames  produced 
every  second.  This  is  depend  ->n  the  number  of  pixels  that  the  target  is 
allowed  to  move  from  frame  to  frame,  which  in  turn  is  dependent  on  the  size 

and  velocity  of  the  target  relative  to  the  imager  and  on  the  zoom  capabili¬ 

ties  of  the  imager.  Since  this  number  is  target  dependent,  it  is  difficult 
to  specify.  For  a  target  100  feet  long,  extending  100  pixels  in  the  imager 
output  array,  and  moving  1000  feet  per  second,  a  frame  rate  of  100  frames 
per  second  would  allow  a  movement  of  10  pixels  per  frame.  This  is  probably 
a  practical  upper  limit  with  a  lower  limit  being  about  1  frame  per  second. 

Note  that  the  upper  limit  corresponds  to  a  bulk  pixel  rate  of  1,000,000  pixels 
per  second ,  which  is  indeed  a  very  high  data  rate ,  but  one  which  can  be 
handled  easily  by  CCDs. 

The  output  control  signals  are  used  to  keep  the  target  within  the  field 
of  view,  with  this  feedback,  the  system  will  be  expected  to  track  a  specified 
target.  There  are  two  approaches  to  deriving  a  set  of  tracking  parameters. 

One  approach  is  Dased  on  relative  positional  measurements,  while  the  other 
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approach  is  based  on  absolute  positional  measurements.  The  relative  approach 
gives  parameters  which  indicate  changes  in  target  position,  size,  and  angle 
of  orientation  relative  to  some  previous  estimate.  The  absolute  approach 
gives  parameters  that  specify  target  position,  size,  and  angle  of  orienta¬ 
tion  in  reference  to  a  fixed  system.  The  TSVIP  approach  is  a  relative  one, 
since  it  gives  frame  to  frame  differences  in  x  and  y  positions,  differences 
in  angle  of  orientation,  and  ratios  of  size  changes.  Note  that  each  para¬ 
meter  set  can  be  estimated  from  the  other  one,  once  a  common  reference 
position  is  established.  Also  note  that  the  relative  approach  may  allow 
errors  in  the  positional  estimate  to  accumulate ,  since  these  errors  are  fed 
back  into  the  input  of  the  system,  while  in  the  absolute  approach  these 
errors  are  not  fed  back.  Which  approach  is  used  will  be  specified  in  the 
discussion  of  the  individual  algorithms  in  the  following  sections. 

5.2  The  Algorithms 

In  this  section  several  feasible  algorithms  for  performing  image  track¬ 
ing  are  introduced.  The  discussion  of  each  algorithm  includes  its  underlying 
principles  and  the  assumptions  it  makes  about  the  input  data.  The  five 
categories  of  the  algorithms  being  investigated  are  referred  to  as  gradient, 
moment,  coordinate,  transformation,  and  segmentation. 

5.2.1  Gradient  Algorithms 
5. 2. 1.1  Development 

These  algorithms  include  the  TSVIP  algorithm  discussed  earlier  in  this 
report  and  Lie  theoretical  methods  [21].  The  fundamental  equation  of  these 
algorithms  can  be  developed  mathematically  either  in  terms  of  a  Taylor  series 
expansion  of  the  equation  governing  motion  of  a  target  or  in  terms  of  group 


I 


89 


theoretic  methods,  but  since  this  development  is  complex  and  can  be  referenc¬ 
ed  elsewhere  [5,21,22],  only  the  results  are  presented  here. 

In  theory  the  fundamental  relation  equates  the  time  derivative  of  the 
image  intensity  at  a  point  as  a  nonlinear  function  of  the  coordinates  of  the 
point  and  the  spatial  derivatives  at  that  point,  and  is  given  from  the  Lie 
formulation  as 

3f/3t  =  a11x(3f/3x)+a12y  (3f/3x)+a21x(3f/3y)+a22y  Of/SyJ+b^^  (3f/3x)+b2  (3f/3y) 

(5. 2. 1.1) 

where  f=f(x,y,t)  is  the  image  intensity  as  a  function  of  the  x-y  image  plane 
and  time.  At  any  given  time,  the  six  coefficients  ,a21'a22'kl'  and 

b2)  are  assumed  constant  over  all  points  within  the  target.  Thus,  an  over¬ 
constrained  set  of  N  linear  equations  (where  N  >6)  in  six  unknowns  can  be 
derived  by  estimating  the  derivatives  at  N  points  within  the  target  at  a 
given  point  in  time.  These  equations  can  then  be  solved  for  the  six  unknowns 
with  any  of  a  large  number  of  descent  procedures  [16,20]  that  can  be  imple¬ 
mented  with  CCDs.  Two  possible  solutions,  the  least  squares  pseudoinverse 
solution  and  the  Widrow-Hoff  sequential  deterministic  solution,  are  developed 
in  Chapter  IV  of  this  report.  One  other  CCD  implementable  solution,  a 
Kalman  filter  formulation  of  the  estimation  problem,  is  proposed  in  this 
chapter.  Since  tv/o  other  algorithm  groups,  moment  and  coordinate,  also 
produce  an  overconstrained  set  of  linear  equations  and  can  be  solved  with 
the  same  procedures,  the  Kalman  procedure  is  presented  in  Section  5.2.4 
after  discussion  of  these  algorithms. 

It  is  interesting  to  compare  the  Lie  formulation  given  by  (5. 2. 1.1) 
with  the  TSVIP  formulation.  Even  though  the  two  equations  are  developed 
from  quite  different  formulations,  they  are  very  similar.  The  only  difference 
is  that  the  TSVIP  algorithm  approximates  the  time  derivative  of  the  intensity 
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function  with  the  difference  between  two  consecutive  frames, 

3f (x,y,t)/3t  =  f (x,y,t+T)-f (x,y ,t)  (5. 2. 1.2) 

There  is  an  interesting  physical  interpretation  of  the  coefficients 

derived  in  these  formulas,  when  the  coefficients  are  constrained  such  that 

=  a^  and  -a^2  =  a.^  =  a  .  This  constraint  restricts  target  motion 

to  translation,  rotation,  and  dilation.  If  the  target  is  rotating  in  the 

image  olane  at  a  rate  d9/dt  about  some  ooint  (x  ,y  )  and  expanding  at  the 

o  o 

rate  of  d >/at  about  this  same  point,  which  is  moving  with  rectangular  velocity 
components  given  by  dx/dt  and  dy/dt,  then  the  constrained  parameters  give 
the  following  relationships : 


d9/dt  =  tan  1 

1+  (1/p) do/dt 
dx/dt  =  b1 


and 


(5.2.1.3a) 

(5.2.1.3b) 


(5.2.1.3c) 


dy/dt  =  b 


(5.2.1.3d) 


If  for  some  small  time  interval,  T,  these  derivatives  (d9/dt,  dp/dt,  dx/dt, 
and  dy/dt)  can  be  assumed  constant,  then  a  constrained  Affine  transformation 
of  coordinates  can  be  given  by 


(5. 2. 1.4) 


X  (t  +  T) 

a  -a 

1  2 

X  (t) 

bl 

= 

+ 

y  (t  t  T) 

a  a 

2  1 

y  (t) 

_b2_ 

where 


a  =  Ip (t+T)/p (t) ]cos [9 (t+T)-0 (t) ] 

a 2  =  [p (t+T)/ p(t) ]sin[9 (t+T) -9 (t)  ] 

b.  =  x  (t+T) -x  (t) 

1  o  o 


b  =  y  (t+T)  -y  (t) 
2  o  o 


and 
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Thus,  a  relativistic  set  of  parameters  about  changes  in  target  orientation, 
position,  and  size  between  consecutive  frames  can  be  generated  as: 


Ax  -  b^ 

(5.2.1.5a) 

Ay  =  b2 

(5.2.1.5b) 

-1 

A  9  =  tan  (a2/a^) 

(5.2.1.5c) 

7  2 

a  =Ua  -s-  a_ 

(5.2.1. 5d) 

11  2 

5. 2. 1.2  Assumptions 

There  are  several  major  assumptions  made  by  gradient  algorithms  about 
the  type  of  data  available  for  processing.  One  important  assumption  is  that 
the  target  has  been  roughly  segmented  in  some  way  from  the  background ,  so 
that  a  set  of  known  target  points  exists  for  processing.  Also  the  target 
must  be  large  enough  so  that  a  sufficient  number  of  sampling  points  exist. 
Note  that  no  assumptions  are  necessary  for  the  background  points.  In  fact  a 
background  is  not  even  required,  unless  it  is  needed  for  segmentation. 

Another  important  assumption  is  that  the  spatial  and  time  derivatives 
at  a  point  can  be  easily  estimated  from  the  sampled  intensity  values  at  that 
point  and  its  surrounding  points.  This  implies  that  the  spatial  and  time 
sampling  rates  must  be  high  enough  for  good  estimates ,  but  not  so  high  that 
the  equations  are  ill-conditioned.  This  requirement  also  relates  to  the 
texture  and  moticr.  of  the  target  in  that  variations  in  image  intensity  values 
from  sampled  point  to  sampled  point  can  neither  be  too  large  nor  too  small. 
Also  since  derivative  estimates  are  very  sensitive  to  noise,  the  noise  levels 
need  to  be  low.  This  can  be  achieved  to  some  degree  by  low  pass  filtering 
the  input  data  before  the  derivative  estimates  are  made. 

A  third  assumption  is  that  an  additional  algorithm  is  being  used  to 
provide  absolute  estimates  of  the  target  position.  This  is  necessary  since 
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relative  estimates  can  accumulate  error  and,  without  an  additional  algorithm, 
can  lose  track  of  the  target. 

The  final  assumption  is  that  the  target  is  restricted  to  motion  as  given 
by  the  unconstrained  Affine  transform.  Since  most  physical  motions  will 
tend  to  be  ones  of  this  type,  this  assumption  is  not  too  critical. 


5.2.2  Moment  Algorithms 


5. 2. 2.1  Development 

These  algorithms  are  based  on  means  and  moments  of  the  input  data  as 
opposed  to  gradients.  They  perform  an  averaging  of  the  data,  and  thus  are 
less  sensitive  to  noise  and  sampling  rates  than  gradient  based  algorithms. 
However,  they  are  very  similar  to  the  gradient  algorithms  in  that  they 
establish  a  fundamental  equation  at  each  point  in  a  target  describing  its 
spatial  and  time  perturbations.  This  fundamental  equation  is  based  on  the 
same  six  unknowns  and  is  derived  from  the  fundamental  gradient  equation  by  a 
spatial  integration  of  it.  The  integration  is  carried  over  a  fixed  area 
centered  on  a  target  point.  If  the  area  is  defined  by  a  <  x  <  b  and 
c  _<  y  <_  d,  then  the  integration  operation  on  the  fundamental  gradient 
equation  yields: 


d  b 

/  / (3f/3t)dx  dy 
c  a 


d  b  d  b 

a^  /  Jx(3f/3x)dx  ^Y+a12  /  / yOf/3x)  dx  dy 

c  a  c  a 


d  b  d  b 

+  b.^  /  /( 3f/3x)dx  dy+a22  /  /y(3f/3y)dy  dx 

c  a  a  c 


b  d  b  d 

+  a  /  /  x(3f/3y)dy  dx+b  /  /( 3f/3y)dy  dx 
2-*-  2 

a  c  a  c 

(5. 2. 2.1) 

'.his  equation  can  be  further  reduced  by  noting  the  following  equalities 


of  calculus : 
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¥ 

:f 


a  b 


/  / [ 3f (x,y , t)/3t]dx  dy  =  3V(t)/3t 


c  a 


a  b  a  a 

/  /x[ 3f (x,y,t)/3x]dx  dy  =  b/f (b,y ,t) dy-a/f (a ,y , t) dy-V(t) 
c  a  c  c 

b  d  b  b 

/  /y[3f (x,y ,t)/3y]dy  dx  =  d/f (x,d ,t)dx-c/f (x,c ,t)dx-V(t) 
a  c  a  a 

d  b  d  <j 

/  /y  (3f (x,y,t)/3x]dx  dy  =  /yf (b,y ,t)ay-/yf (a,y ,t) dy 
c  a  c  c 

b  d  b  b 

/  /x[3f (x,y,t)/3y]dy  dx  =  /x f (x,d, t)dx-/xf (x,c ,t)dx 
a  c  a  a 

a  b  a  d 

/  / [3f (x,y,t)/3x]dx  dy  =  /f (b,y,t)dy-/f (a,y,t)dy 
c  a  c  c 

be  b  b 

/  /[ 3f (x,y ,t)/3y]dy  dx  =  /f (x,d,t)dx-/f (x,c,t)dx 
a  c  a  a 


(5.2.2.2a) 


(5.2.2.2b) 


(5.2.2.2c) 


(5.2.2.2a) 


(5.2.2.2e) 


(5.2.2 .2f) 


(5.2.2.2g) 


where 

a  b 

V(t)  =  /  / f (x,y ,t)dx  dy 
c  a 

Note  that  this  reduction  eliminates  all  but  one  derivative  operation ,  and 
replaces  them  with  zero  and  first  order  moment  calculations  of  the  windowed 
area  and  its  boundaries.  Again  the  single  time  derivative  operation  in 
(5.2.2.2a)  can  be  replaced  by 


3V(t)/3t  -  V (t+T) -V (t) 


(5.2.2. 3) 


as  long  as  the  time  sampling  rate  is  fast  enough  or  the  image  evolves  slow 
enough  to  make  this  approximation  valid. 

Since  the  data  are  discrete,  the  integral  operations  must  also  be 
approximated  by  some  numerical  integration  technique.  The  simplest  and  most 
easily  implementable  with  CCDs  is  the  rectangular  rule: 
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b  N-l 

/ g(x)dx  =  £  g(a+nAx)Ax  (5. 2. 2. 4) 

a  n=0 

where  Ax  =  (b-a)/N.  Thus,  all  the  integration  operations  in  (5. 2. 2. 2)  can  be 
developed  as  weighted  sums  of  ordered  pixels  and  thereby  be  implemented  with 
CCD  based  structures. 

Since  the  coefficients  are  identical  in  the  two  formulations,  they  have 
the  same  interpretation  as  given  by  (5. 2. 1.3),  and  they  generate  the  same 
relative  set  of  control  signals  as  given  by  (5. 2. 1.5).  Also  they  can  be 
calculated  using  the  pseudo-inverse  formulation  or  the  Widrow-Hoff  formula¬ 
tion  as  presented  earlier  in  this  report,  or  using  the  Kalman  formulation 
presented  in  Section  5.2.4. 


5. 2. 2. 2  Assumptions 

With  few  exceptions  the  assumptions  made  by  these  algorithms  are 
essentially  identical  to  those  made  by  the  gradient  based  algorithms  as 
presented  in  Section  5. 2. 1.2.  However  these  algorithms  do  not  require 
special  constraints  on  the  spatial  sampling  rate  or  the  texture  of  the  object, 
nor  do  they  require  a  low  noise  level  as  in  the  gradient  algorithms. 

5.2.3  Coordinate  Algorithms 
5.2. 3.1  Derivation 

The  coordinate  based  algorithms  also  produce  an  overdetermined  set  of 
linear  equations  as  do  the  gradient  and  moment  algorithms,  but  they  do  not 
require  the  estimation  of  either  the  gradient  at  any  point  or  the  moment  of 
any  region.  They  do  however  require  the  accurate  identification  of  the 
locations  of  a  fixed  number  of  points  in  consecutive  frames.  If  a  subset 
cf  N  points  from  the  target  can  be  accurately  tracked  in  each  frame,  then  the 
target  as  a  whole  can  also  be  tracked.  Labelling  these  N  points  as 
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(x^Ct),  y^ (t) ) ,  (x2(t),  y2(t)),  ...  ,  (xN(t),  yN(t)),  the  linear  set  of 
equations  become 


x  (t+T)  =  b^+  a^x^ft)  +  ai2yi(t) 

yi(t+T)  “  V  a21Xl(t)  +  a22yl(t) 
x2(t+T)  =  bx+  a  x2 (t)  +  a12y2 (t) 

y2 (t+T)  =  b2+  a21x2(t)  +  a22y2(t) 


I 


s 


V®")  ■  V  aii*s(t>  *  ai2ynlt) 

Vt+T>  =  bf  ajA(t)  ♦  a22yN(t)  (5.2.3.1) 

The  coefficients  correspond  to  those  of  the  unconstrained  Affine  transforma¬ 
tion  as  given  in  (5. 2. 1.1)  or  (5. 2. 2.1),  and  thus  have  tve  same  physical 
interpretation  and  output  the  same  control  signals  as  both  the  gradient  and 
moment  algorithms.  They  can  also  be  solved  using  the  same  methods. 

The  major  difference  is  that  accurate  segmentation  of  a  few  points  is 
required.  If  that  can  be  done,  and  since  this  formulation  does 
not  need  the  image  intensity  value  at  any  point,  both  noise  problems  and 
spatial  and  time  sampling  constraints  can  be  ignored.  Since  noise  does  not 
work  into  the  equations ,  a  more  accurate  solution  can  be  obtained-  Unfor¬ 
tunately,  the  task  of  tracking  a  select  set  of  image  points  is  very  target 
dependent  and  may  be  too  difficult  to  implement  with  any  reasonable  algorithm 
or  hardware . 

5.2. 3.2  Assumptions 

The  coordinate  based  algorithms  have  only  two  major  assumptions.  The 
first  and  most  prohibitive  is  that  accurate  positional  identification  of  a 
select  set  of  points  is  required  in  successive  frames.  This  assumes  that 


, 


whe»-e  k  is  the  iteration  index,  A(k)  represents  the  sequential  estimates  of 


T  th 

the  unconstrained  Affine  parameters,  and  X  (k)  represents  the  k  data  set 


derived  either  by  gradient,  moment,  or  coordinate  calculations.  The  elements 


of  X  (k)  represent  the  data  weights  on  the  corresponding  coefficients  in  A(k) 


th 


so  that  the  k  derived  equation  from  any  of  the  techniques  is  represented  by 


Z(k)  =  A  (k)X(k)  (5. 2. 4. 2) 

where  Z(k)  is  the  left  side  quantity  as  given  in  (5.2.1.1) , (5.2.2.1)  ,  or 
(5.2. 3.1) . 

Since  the  Affine  parameters  are  assumed  constant  over  all  observations 
in  a  particular  frame,  A(k)  can  be  modeled  as  the  following  Markov  process: 


A(k+1)  =  A(k)  +  u(k) 


(5.2.4. 3) 


where  u(k)  is  modeled  as  a  stationary  white  noise  process  with  variance  V  , 


thus  allowing  for  the  error  in  the  parameter  estimates  from  different 
observations.  The  observation  equation  can  then  be  given  as 


Z(k)  =  A  (k)X(k)  +  v(k) 


(5. 2. 4. 4) 


where  v(k)  is  modeled  as  a  stationary  white  noise  process  with  variance  V 


v 


Assume  that  A(0)  is  a  random  vector  with  variance  V, (0) . 

A 


Finally  the  estimation  equations  come  directly  from  applying  the  above 
equations  to  Kalman  filter  theory,  and  are  given  as 


A(k+1)  =  A(k)  +  p(k)X(k) [Z(k)  -  A  (k)X(k)] 


p (k)  =  VA(k)/[vJ  +  xT(k)VA(k)X(k)] 


(5.2.4.5a) 

(5.2.4.5b) 


and 


Vft(k+1)  =  [I  -  p(k)X(k)X  (k)]V  (k)  +  Vu 


(5.2.4.5c) 


Thus,  all  that  is  needed  to  start  the  sequence  of  estimation  is  to  choose  V^, 


V  ,  A (0) ,  and  V  (0) .  The  rate  of  convergence  is  influenced  by  both  V  and  V  . 
v  A  u  v 
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If  V  is  chosen  to  be  small,  then  from  (5.2.4.5c)  the  product  (p(k)X(k)X  (k) ) 

is  nearly  equal  to  the  identity  matrix  and  V^(k)  will  converge  to  its 

minimum  value  V  too  quickly.  Conversely  if  V  is  chosen  to  be  large,  V  (k) 
u  v  A 

will  tend  to  V  very  slowly.  The  choices  for  A(0)  and  V, (0)  are  interdependent, 
u  A 

in  that  V  (0)  should  be  chosen  small  if  the  initial  estimate  A(0)  is  thought 
A 

to  be  accurate  or  V^fO)  should  be  chosen  large  if  the  estimate  is  believed 

to  be  inaccurate .  Note  that  the  estimates  should  vary  little  from  frame  to 

frame,  so  that  if  the  estimate  from  the  previous  frame  is  used  for  A(0) , 

then  V  (0) ,  V  ,  and  V  should  be  chosen  small  for  quick  convergence  to  an 
A  v  u  _ 

accurate  solution.  A  few  startup  frames  should  be  sufficient  to  accurately 
choose  A (0) . 

Implementation  of  this  technique  is  more  difficult  than  the  Nidrow-Hoff 
technique,  but  note  the  estimation  similarities.  The  major  difference  is 
that  the  gain  on  the  error  term  is  a  6  x  6  matrix  in  tnis  formulation,  and 
it  is  a  scalar  in  the  Widrow-Hoff  formulation.  In  spite  of  the  higher 
complexity,  the  Kalman  formulation  is  still  CCD  implementable  since  it  does 
not  require  any  large  inverses  but  rather  parallel  computation  of  inner 
products.  Also  the  increase  in  hardware  over  the  Widrow-Hoff  estimator  may 
be  an  acceptable  trade-off  for  the  decrease  in  convergence  time  offered  by 
the  Kalman  estimator. 

5.2.5  Transformation  Algorithms 


5. 2. 5.1  Derivation 

The  basic  principle  behind  these  algorithms  is  to  transform  the  image 


1 


2 

1 

1 

I 


input  data  into  a  new  set  of  data  where  the  computations  of  rotational, 
translational,  and  dilational  parameters  are  made  easier.  This  section 
investigates  some  of  the  properties  of  the  Fourier  transform  and  a  geometric 
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coordinate  transform  denoted  as  the  Log-Polar  transform.  The  function  of 
each  of  these  transforms  in  computing  certain  motion  parameters  is  then 
discussed. 

The  spatial  Fourier  transform  of  an  image  f(x,y,t)  is  given  by 

CO  oo 

F(u,v,t)  =  /  /  f (x,y  ,t)exp[-2irj(ux+vy) ]dx  dy  (5. 2. 5.1) 

—  CO  —00 

The  following  properties  show  the  effects  that  translation,  dilation,  and 
rotation  of  an  image  f(x,y,t)  has  upon  its  Fourier  transform.  If 
f (x,y jtJ-^FfUjVjt)  indicates  the  Fourier  pair,  then 

f(x-XQ,  y-y  ,  t)«->exp[-27r  j  (uxq  +  vyQ)  ]F  (u,v,t)  (5.2.5.2a) 

f  (ax, ay  ,t)-<-v  (1/a) 2  [F(u/a,v/a)  ]  (5.2.5.2b) 

and 

f(r,  0+9  )+-»-F(w,({)+0  )  (5.2.5.2c) 

o  o 

where  f(r,0+9Q)  represents  a  0q  rotation  of  the  image  about  the  origin. 

There  are  three  important  results  of  the  above  properties.  The  first  is  that 
the  magnitude  of  the  Fourier  transform  is  invariant  to  translation.  The 
second  is  that  scaling  the  image  function  also  scales  the  Fourier  transform. 
And  lastly,  a  rotation  about  the  origin  in  the  image  plane  results  in  a 
rotation  about  the  origin  of  the  same  amount  in  the  Fourier  transform  plane. 

The  Log-Polar  transform  is  based  on  the  conversion  from  rectangular  to 
polar  coordinates  and  is  given  as 

L(u,v,t)  =  f[ln(x"+  y2)*5,  tan  1  (y/x)  ]  (5.2.5. 3) 

Basical1 j  the  image  function  is  converted  to  polar  coordinates,  the  natural 
logarithm  is  applied  to  its  magnitude  coordinate,  and  the  new  coordinate 
system  is  interpreted  as  rectangular  coordinates.  If  f(x,y,t)  -*-L(u,v,t) 
represents  this  transformation  then  the  following  properties  result: 
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f(ax,ay,t)  -+  L(u  +  ln(a)  ,v,t)  (5.2.5.4a 

and 

f(r,0+0  )  L (u, v  +  9  ,t)  (5.2.5.4b) 

o  o 

where  f(r,9+9Q)  represents  a  9^  rotation  of  the  image  about  the  origin.  Note 
that  this  transformation  produces  a  simple  translation  in  the  transformed 
domain  given  a  rotation  and  dilation  in  the  image  domain.  Also,  using  the 
translation  invariance  of  the  magnitude  of  the  Fourier  transform,  a  transfor¬ 
mation  of  the  image  function  that  is  invariant  to  translation,  rotation,  and 
dilation  can  be  obtained.  This  is  done  by  computing  the  magnitude  of  the 
Fourier  transform  of  the  Log-Polar  transform  of  the  magnitude  of  the  Fourier 
transform  of  the  original  data.  This  invariant  transform  is  useful  in 
pattern  recognition  problems  by  characterizing  objects  subject  to  rotation  , 
dilation,  and  translation.  If  the  image>  loses  track  of  the  target,  a  pattern 
recognition  routine  can  take  over  to  match  the  last  frame  containing  the 
target  with  a  new  frame  zoomed  back  to  show  a  much  larger  image  plane,  and 
this  transform  can  be  used  to  locate  the  missing  target. 

A  transform  of  the  image  plane  which  is  invariant  to  translation , 

rotation,  and  dilation  is  certainly  useful,  but  doesn't  yield  the  parameters 

that  indicate  the  amount  of  movement.  To  do  this  using  these  transforms, 

matched  filtering  is  required.  The  actual  procedure  that  must  be  performed 

is  too  complex  to  detail  in  this  report,  so  only  a  brief  description  of  this 

procedure  is  outlined. 

* 

Matched  filtering  is  essentially  a  normalized  cross-correlation  between 
a  function  and  a  reference  function.  In  this  application,  a  windowed  region 
containing  part  of  the  target  of  a  previous  frame  is  used  as  a  reference 
function  and  is  matched  filtered  with  the  current  frame  where  the  target 
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has  undergone  only  translation.  The  matched  filter  produces  an  image  that 
has  a  value  at  the  location  where  the  target  has  shifted  to.  Unfortunately 
the  target  is  only  allowed  to  undergo  translation. 

If  the  target  undergoes  translation,  rotation,  and  dilation,  then  the 
rotation  and  dilation  parameters  can  be  found  by  match  filtering  the  Log- 
Polar  transform  of  the  magnitude  of  the  Fourier  transform  of  the  reference 
plane  with  a  similar  transformation  of  the  current  plane.  The  peak  value 
in  the  match  filter  output  indicates  the  amount  of  rotation  and  dilation. 

Once  these  coefficients  are  found,  they  can  be  applied  to  the  current 
image  to  correct  for  any  rotation  and  dilation  of  the  reference  image.  The 
result  can  then  be  inverse  Fourier  transformed  and  match  filtered  with  the 
reference  image.  The  peak  now  indicates  the  translation  movements  since  the 
reference  image. 

The  number  of  computations  that  must  be  performed  to  derive  the  movement 
parameters  is  enormous.  However,  many  of  the  necessary  operations  can  take 
advantage  of  the  high  speed  and  parallel  processing  nature  of  CCDs.  The 
fourier  transform  is  implemented  with  the  discrete  Fourier  transform  which 
has  a  CCD  implementable  form.  Also  match  filtering  is  simply  convolution 
with  a  spatially  reversed  reference,  and  CCDs  can  be  structured  to  handle 
two  dimensional  convolutions.  Operations  such  as  tangents,  logarithms, 
magnitudes ,  and  squaring  can  be  implemented  with  special  purpose  high  speed 
analog  or  digital  hardware. 


5. 2. 5. 2  Assumptions 

There  are  several  assumptions  made  by  this  procedure  for  identifying 
the  tracking  parameters.  The  foremost  one  is  that  this  algorithm  allows 
only  translation,  dilation,  and  rotation.  Noise  and  rotation  about  an  axis 
not  perpendicular  to  the  viewing  plane  are  not  accounted  for,  and  thus  will 
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cause  errors  in  the  parameters  that  are  measured.  Another  assumption  is  that 
the  noise  must  either  be  low  level  or  stationary  and  white ,  since  the  match 
filter  is  optimum  onl''  in  the  presence  of  white  noise.  Finally,  unlike  the 
previous  algorithms,  large  changes  in  position,  size,  and  orientation  are 
all  allowed  by  this  algorithm,  and  so  no  assumptions  about  the  time  sampling 
rate  need  to  be  made. 


5.2.6  Segmentation  Algorithms 

The  purpose  of  these  algorithms  is  to  segment  the  target  from  the  back¬ 
ground  and  then  use  this  segmented  image  to  estimate  the  target  size, 
position,  and  orientation.  There  are  two  computational  parts  to  these 
algorithms:  Segmentation  and  parameter  estimation.  Three  segmentation 
methods  denoted  by  intensity  methods,  texture  methods,  and  Gestalt  methods 
are  suggested.  Two  parameter  estimation  methods  denoted  by  principal  axis 
methods  and  projection  methods  are  proposed. 

5. 2. 6.1  Intensity  Segmentation 

These  methods  assume  that  the  gray  levels  belonging  to  the  target  pixels 
are  significantly  different  from  those  of  the  background.  In  this  case  seg¬ 
mentation  can  be  achieved  by  thresholding  with  the  appropriate  thresholds. 

The  difficulty  lies  in  the  determination  of  these  thresholds.  If  some  a 
priori  knowledge  is  available  about  the  distribution  of  target  and  background 
intensity  values  is  available,  then  a  Bayesian  criterion  can  be  used  to 
determine  the  optimum  thresholds.  If  not,  then  a  histogram  of  the  image  can 
be  computed  and  the  intensity  levels  belonging  to  the  target  can  be  identified 
if  only  the  shape  of  the  target  distribution  is  known.  Another  possibility 
would  be  to  apply  the  above  methods  to  either  a  low-pass,  high-pass,  or  band¬ 
pass  version  of  the  image.  The  filtered  image  may  have  target  pixels  whose 
intensity  are  distinct  from  those  of  the  background. 
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The  exact  method  used  for  intensity  segmentation  is  highly  dependent  ] 

on  the  assumptions  made  about  the  target.  Since  the  expected  range  of 
applications  is  large,  no  assumptions  will  kw  presented  in  this  investigation. 

Only  possible  procedures  are  suggested.  \ 

5. 2. 6. 2  Texture  Segmentation  j 

These  algorithms  assume  that  the  texture  of  the  target  is  significantly 
different  from  that  of  the  background.  Texture,  however,  is  a  subjective 
quality.  One  means  of  giving  texture  a  quantitative  measure  comes  from 
linear  prediction  theory.  Linear  prediction  provides  a  set  of  coefficients  ; 

which  will  vary  from  texture  to  texture,  and  is  based  on  linearly  predicting  ] 

the  intensity  value  of  a  pixel  by  a  weighted  sum  of  surrounding  pixels.  • 

These  weights  are  the  linear  prediction  coefficients,  are  assumed  to  be 

i 

constant  over  a  given  texture ,  and  can  be  computed  by  structuring  an  over-  : 

constrained  set  of  linear  equations  where  the  coefficients  are  the  unknowns, 

and  using  any  of  the  CCD  implementable  techniques  suggested  in  this  report  j 

for  solving  this  kind  of  problem.  Once  the  weights  for  a  particular  type  s 

j 

of  texture  are  found,  then  the  linear  prediction  can  be  applied  to  the  image  ; 

* 

array  as  a  CCD  implementable  convolution.  The  squared  error  between  the  ; 

predicted  value  and  actual  value  can  then  be  thresholded  to  determine  j 

whether  or  not  a  particular  pixel  belongs  to  the  texture  on  which  the  co-  I 

i 

efficients  were  trained.  Thus  the  segmentation  is  complete.  Results  of  this  | 

approach  to  image  segmentation  are  given  in  [23].  A  filtered  version  of  the  j 

image  may  provide  a  better  texture  with  which  to  work,  but  this  is  dependent  I 

on  any  assumptions  made  a  priori  about  the  target.  = 

a 

A  major  assumption  made  by  this  algorithm  is  that  some  kind  of  rough  5 

segmentation  is  required  to  identify  the  pixels  to  be  used  in  training  the  | 

% 

linear  predictor  coefficients.  If  the  target  is  expected  to  be  in  the  \ 
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center  of  the  image  (as  during  tracking) ,  then  the  texture  filter  can  be 
trained  there  or  along  the  edges. 


5.2.6. 3  Gestalt  Segmentation 

In  this  approach  the  segmentation  method  is  based  on  the  Gestalt  law 
of  common  fate,  which  implies  tnat  if  several  image  regions  appear  to  move 
together,  they  are  treated  as  a  single  object.  The  algorithms  used  in  this 
technique  may  be  the  same  as  those  used  for  gradient,  moment,  coordinate, 
or  transform  algorithms  discussed  in  earlier  sections.  Here  these  algorithms 
are  applied  to  small  nonoverlapping  regions  within  the  input  image  and  the 
movement  parameters  of  each  region  are  computed.  Those  regions  whose 
parameters  are  close  in  some  vector  norm  sense  are  grouped  either  to  the 
target  or  background,  thus  performing  segmentation. 

This  technique  makes  the  same  assumptions  as  the  tracking  algorithm 
being  used.  The  primary  difference  is  that  the  regions  are  smaller  and  fewer 
points  are  available  for  computing  the  tracking  parameters  within  each 
region.  Also  this  type  of  segmentation  is  rougher,  since  it  assigns  regions 
of  pixels  to  target  or  background  as  opposed  to  individual  pixels. 

5. 2. 6. 4  Principal  Axis  Parameter  Estimation 

Or  a  binary  image  is  produced  from  the  appropriate  segmentation 
algorithm,  an  estimate  of  target  position,  orientation,  and  size  is  needed. 

The  principal  axis  method  first  estimates  the  centroid  of  the  target  image 
by  summing  the  coordinate  values  of  points  belonging  to  the  target.  The 
average  x  and  y  coordinate  that  results  is  used  as  the  position  of  the  target. 
Next  a  line  which  contains  that  point  is  obtained  by  minimizing  the  sum  of 
the  square  of  the  perpendicular  distances  from  all  target  points  to  that 
line  with  respect  to  the  slope  of  the  line.  The  angle  formed  between  the 
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line  (principal  axis)  and  a  reference  line  yields  the  angle  of  orientation. 

The  size  estimate  is  then  made  by  computing  the  number  of  pixels  classified 
as  belonging  to  the  target.  Note  that  the  above  calculations  can  be  done 
with  weighted  sums  of  coordinate  values ,  and  thus  can  be  implemented  with 
CCDs. 

5. 2. 6. 5  Projection  Parameter  Estimation 
A  faster  algorithm  may  be  provided  by  this  approach.  This  method  first 
projects  the  binary  image  onto  the  x  and  y  axes.  That  is,  the  number  of 
pixels  belonging  to  the  target  along  each  row  and  along  each  column  is  com¬ 
puted  and  stored.  As  in  the  principal  axis  approach  the  total  number  of 
target  classified  pixels  is  used  as  the  size  estimate.  Now  however,  the 
position  is  determined  by  computing  the  one-dimensional  centroids  of  the  two 
orthogonal  projections.  The  one-dimensional  centroid  can  be  computed  by  a 
summation  of  coordinate  values  weighted  by  the  number  of  pixels  from  the 
target  assigned  to  that  coordinate.  The  angle  of  orientation  can  be  computed 
by  performing  this  one-dimensional  centroid  calculation  on  the  four  sections 
of  the  projections  separated  at  the  centroids  computed  earlier.  The  angle 
of  orientation  is  thus  given  by 

0  =  tan_1[ (YT-YB)/(XT-XB) ]  (5. 2. 6.1) 

T  B  T  B  .  . 

where  Y  ,  Y  ,  X  ,  and  X  are  the  centroids  for  the  top  and  bottom  y  projection 

and  the  top  and  bottom  x  projection  respectively.  Note  that  the  computations 

made  by  this  algorithm  can  be  performed  mostly  by  CCDs. 

5. 2. 6. 6  Assumptions 

There  are  several  assumptions  made  by  segmentation  algorithms.  One 
important  assumption  is  that  the  entire  target  is  in  the  field  of  view  of 
the  input  image  array.  ihis  is  necessary  so  that  the  differentiation  between 
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target  and  background  can  be  used  for  segmentation  and  position  estimation.  % 

Another  important  assumption  is  that  there  is  a  difference  between  the  f 

target  and  background,  and  that  the  difference  is  dependent  on  the  applica-  § 

ss 

tion  and  therefore  must  be  known  a  priori.  This  is  so  the  hardware  can  be  | 

structured  to  segment  based  on  only  one  type  of  difference ,  whether  that  be  f 

I 

js- 

intensity  differences,  texture  differences,  or  motion  differences.  Although  f 

the  parameter  estimation  algorithms  are  relatively  insensitive  to  a  small  f 

§ 

n unite’'  of  misclassif ications ,  the  algorithms  will  not  work  well  with  only  i 

3 

a  rough  segmentation  performed.  I 


5,3  Implementation 

As  a  demonstration  of  the  practicality  of  this  algorithm  search,  an 
example  system  is  developed  in  this  section.  This  example  is  not  a  proposal 
for  hardware  design,  nor  does  it  necessarily  represent  the  optimum  approach, 
but  it  does  serve  to  illustrate  the  CCD  structure  of  a  viable  alternative 
to  the  proposed  system.  The  design  presented  in  this  section  is  based  on  the 
moment  tracking  algorithm  of  section  5.2.2  and  the  Kalman  parameter  identifi¬ 
cation  algorithm  of  section  5.2.4.  It  is  assumed  that  there  is  a  single 
target  centered  in  the  field  of  view  (FOV)  occupying  a  significant  area 
(greater  than  1%  of  FOV) ,  The  problem  of  identifying  and  locking  the  target 
within  the  field  of  view  is  not  considered  in  this  design.  The  overall 
system  configuration  is  shown  in  Figure  5-1,  The  functions  of  the  imager, 
preprocessor,  moment  estimator,  parameter  estimator,  and  imager  controller 
are  discussed  individually  in  the  follow  sections.  In  addition,  functional 
diagrams  of  the  moment  and  parameter  estimators  are  developed.  The  timing 
and  control  functions  are  discussed  within  each  of  the  other  functional 
block  descriptions. 
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Example  System  Configuration 
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5.3.1  Imager 

The  imager  is  a  CCD  image  array  of  10C  by  100  pixels.  It  is  highly 
sensitive  to  the  infrared  spectrum,  since  it  is  assumed  that  all  targets  of 
interest  will  appear  warm  against  a  cold  background.  The  exposure  (integra¬ 
tion)  time  is  variable  and  controlled  by  the  timing  and  control  unit.  The 
amount  of  exposure  is  determined  by  the  light  intensity  of  the  field  of  view, 
so  that  the  contrast  between  the  target  and  background  is  sharp  enough  for 
accurate  identification  of  target  points  by  their  intensity  values.  A  frame 
rate  of  10  frames  per  second  allows  a  maximum  exposure  time  of  .01  seconds 
and  a  processing  time  of  .09  seconds  before  the  next  frame  is  exposed.  After 
exposure,  the  discrete  analog  data  is  transferred  from  the  CCD  image  array 
one  pixel  at  a  time  at  a  1  MHz  rate.  A  gated  10  KHz  clock  is  used  to  clock 
the  data  up  one  row  with  the  top  row  being  lost  and  the  bottom  row  given 
appropriate  values  in  preparation  for  the  next  exposure.  The  top  row  is 
clocked  to  the  right  with  a  1  MHz  clock  with  a  readout  on  the  upper  right 
cornei  pixel.  Thus  the  data  is  clocked  out  with  the  appropriate  signals 
from  the  timing  and  control  box  in  the  order  shown  in  Figure  5-2.  Note  that 
if  the  top  N  rows  are  not  needed,  then  they  may  be  clocked  out  at  a  rapid 
rate,  and  readout  may  start  on  the  N  +  1  row. 


5.3.2  Preprocessor 

The  primary-  function  of  the  preprocessor  section  is  to  prepare  the  data 
for  the  moment  estimator.  This  may  include  low  pass  filtering  to  eliminate 
high  frequency  noise  or  weighted  correction  of  nonlinearitics  in  the  imager. 

In  this  design,  it  is  used  to  normalize  the  data,  so  that  the  target  contrasts 
sharply  with  the  background  and  there  are  sufficient  intensity  variations 
within  the  target  to  provide  good  moment  estimates.  Histogram  equalization 
is  one  means  of  performing  this  normalization,  but  the  associated  hardware 
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is  too  complex-  A  simpler  but  effective  method  is  to  subtract  out  the  mean 
of  the  data  at  each  point,  then  divide  the  resulting  data  by  its  variance. 
This  will  give  a  normalized  data  set  with  zero  mean  and  unit  variance. 

Another  function  of  this  preprocessor  is  to  reduce  the  bulk  of  the  data. 
Since  the  target  is  assumed  to  be  roughly  in  the  center  of  the  frame,  only 
the  center  32  by  32  pixels  are  kept  for  processing.  Since  the  timing  and 
control  unit  knows  when  each  pixel  is  clocked  out  of  the  image  array,  it  can 
generate  the  appropriate  signals  for  clocking  the  center  area  into  a  1024 
stage  CCD  shift  register.  A  diagram  of  the  preprocessor  with  the  data 
reduction  and  normalization  functions  is  shown  in  Figure  5-3. 


5.3.3  Moment  Estimator 

The  moment  estimator  receives  the  data  from  the  preprocessor  and  stores 

it  in  a  100  stage  CCD  array,  which  is  tapped  in  such  a  way  that  4  by  4 

square  regions  are  available  for  moment  estimation.  These  sixteen  taps  are 

then  multiplied  by  their  digital  coordinates  and  summed  to  provide  the  five 

moment  estimates  needed  for  the  constrained  Affine  parameter  estimation. 

Let  Figure  5-4  establish  a  coordinate  system.  Using  the  expansion  given  by 

(5.2.2. 2)  and  the  approximation  given  by  (5.2.2. 3)  and  (5. 2. 2. 4)  ,  and 

constraininc  the  Affine  oarameters  such  that  a, ,  =  a„„  =  a,  and  -a,,  =  a,,= 

11  22  1  12  21 

a^,  the  basic  equation  of  (5. 2. 2.1)  becomes 

w(k,t+T)  =  w(k,t)  =  a  x. (k.t)  +  a  x  (k,t)  +  b  x  (k,t)  +  b  x  (k,t) 

lx  22  13  24 
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(5.3.3b) 
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3 

x  (k,t)  =  £  [ (y+3) f (x+i,  y+3,  t)  -  (y)f(x+i,  y,  t) ] 

i=0 


+  l  [ (x+3) f (x+3 ,  y+j,  t)  -  (x)f(x,  y+j,  t) ] 
j=0 

3  3 

-2  l  l  f (x+i ,  y+j,  t) 
i=0  j=0 

3 

=  l  (x+i) [f (x+i ,  y+3,  t)  -  f(x+i,  y,  t) ] 
i=0 

3 

“  I  (y+j)[f(x+3,  y+j,  t)  -  f(x,  y+j,  t)] 
j=0 


(5.3.3c) 


x2 (k,t) 


x^  (k, 


t)  =  l  [f (x+3 ,  y+j,  t)  -  f (x ,  y+j,  t) ) 
j=0 


and 


x  (k,t)  =  l  [f (x+i ,  y+3,  t)  -  f(x+i,  y,  t) ] 
i=0 


(5.3.3d) 


(5.  3. 3e) 


(5. 3. 3f; 


Note  that  these  sums  of  products  are  CCD  implemen table.  The  coordinates  are 
digital  values  supplied  by  the  timing  and  control  unit,  thus  every  multiplica¬ 
tion  is  analog  by  digital  with  analog  output  and  every  summation  is  analog. 

The  diagram  of  the  hardware  needed  for  this  moment  estimator  is  shown  in 
Figure  5-5.  Figures  5-6  and  5-7  show  further  details  of  the  multiplication 
and  summation  sections. 

5.3.4  Parameter  Estimator 

The  parameter  estimator  implements  the  Kalman  estimator  as  given  in 
(5. 2.4. 5)  and  is  formulated  for  this  problem  as: 


A (k+1)  =  A (k)  +  v  (k)X(k) [Z(k)  -  A  (k)X(k) ]/p(k) 


V  (k+l)=  v  (k)  +  V  -  V  (k) X (k) X  (k)  V ,(k)/p(k) 
A  A  u  A  A 


where 


P (k)  =  Vv2  +  XT(k)VA(k)X(k) 


(5.3.4a) 

(5.3.4b) 

(5.3.4c) 


ClOCK 


A(k)  =  (a^(k,t)  a2(k,t)  b^^t)  b2(k,t)]T  (5.3.4d) 

x(k>  =  [x^(k,t)x2(k,t)  x2(k,t)  x4(k,t)]T  (5.3.4e) 

and 

Z(k)  =  W(k,t)  -  W(k,t-T)  (5. 3.4f) 

Note  that  A(0) ,  VA(0) >  and  must  be  initialized  to  some  value  before 
processing . 

The  complexity  of  this  algorithm  requires  high  speed  processing.  There¬ 
fore,  special  purpose  digital  hardware  is  used  to  implement  this  function.  Due 
to  the  high  speed  requirements,  as  much  of  the  processing  as  possible  is  per¬ 
formed  in  parallel.  A  diagram  of  the  hardware  implementation  of  this  algorithm 
is  shown  in  Figure  5-8. 

5.3.5  Imager  Controller 

The  imager  controller  consists  of  that  hardware  which  controls  the  field 
of  view  for  the  image  array.  In  this  application,  it  is  assumed  that  the 
image  array  is  located  in  a  small  enclosure  which  can  pan  left  and  right 
or  tilt  up  and  down.  Also  a  lens  system  allows  zoom  and  focus  control.  The 
imager  controller  receives  the  parameter  estimates  from  the  parameter 
estimator,  refines  these  estimates  using  the  estimates  from  the  previous 
frames,  then  generates  the  appropriate  control  signals  to  center  the  target 
witnin  the  field  of  view.  The  hardware  involved  in  this  implementation  is 
beyond  the  scope  of  this  investigation,  and  thus  will  not  be  presented  in 
this  section. 

5.4  Summary 

Several  algorithms  for  performing  image  tracking  have  been  presented  in 
this  section.  A  CCD  based  implementation  wit!"  analog  and  digital  support  has 
been  suggested  for  each  algorithm,  and  thus  earn  one  appears  to  be  feasible 
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for  use  either  as  a  substitute  for  the  TSVIP  algorithm  or  as  a  support 
algorithm  for  it.  Further  studies  will  be  required  to  make  this  determina¬ 
tion. 

Thei.e  are  distinct  advantages  and  disadvantages  among  the  algorithms. 

The  segmentation  algorithms  provide  better  lock  capabilities  than  the  gradient, 
moment,  or  coordinate  based  algorithms,  since  they  provide  absolute  tracking 
measurements  referenced  to  a  fixed  coordinate  system  as  opposed  to  relative 
tracking  measurement  referenced  to  the  previous  frame.  The  transform  based 
algorithms  require  more  computations  than  the  othe*  algorithms.  The  sequential 
solution  offered  by  the  Kalman  estimator  or  the  Widrow-Hoff  estimator  has  a 
more  efficient  hardware  structure  than  a  pseudo-inverse  implementation,  but 
a  slow  rate  of  convergence  could  easily  offset  this  advantage.  The  segmenta¬ 
tion  and  transform  algorithms  can  tolerate  a  slower  sampling  rate  even  for 
fast  targets,  while  the  coordinate  algorithms  can  tolerate  a  lower  spatial 
sanpling  rate.  All  the  algorithms  can  model  rotation,  dilation,  and 
translation,  but  the  segmentation  algorithms  are  not  affected  by  any  movements. 
They  are  affected  however  by  changes  in  texture  or  intensity.  The  gradient 
algorithms  are  very  noise  sensitive. 

Thus  there  are  many  advantages  and  disadvantages  that  can  now  be  observed 
among  the  possible  algorithms.  Table  5-1  roughly  summarizes  these,  but  the 
final  decision  must  be  based  on  simulation  studies  and  hardware  proposals. 

A  program  to  simulate  a  moving  target  has  been  developed.  This  will  provide 
a  common  data  base  to  test  the  algorithms.  The  algorithms  need  to  be  develop¬ 
ed  as  computer  programs ,  and  performance  indices  must  be  created  to  measure 
their  performance  with  the  common  data  base.  A  supplementary  report  on  this 
task  giving  a  summary  of  the  performance  data  will  be  provided  later,  or  the 
information  will  be  available  from  a  journal  publication. 
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CHAPTER  VI 

RECOMMENDED  FUTURE  RESEARCH 

Tracking  and  guidance  using  computer  vision  has  much  to  offer  in  both 
military  and  civilian  applications  for  a  broad  spectrum  of  activities. 
Systems  that  can  look  over  the  horizon  and  recognize  specific  patterns  and 
then  provide  homing  signals  have  many  generic  problems  that  are  identical  to 
those  of  systems  which  pick  cabbages  from  a  moving  vehicle  or  perform  tasks 
on  the  factory  floor,  so  military  technology  will  benefit  from  advanced 
automation  and  other  computer  vision  research  in  progress  both  here  and 
abroad.  However,  some  research  dedicated  to  tracking  and  guidance  is 
required  to  be  certain  that  problems  specific  to  this  area  are  solved 
in  a  timely  manner. 

Our  results  on  CCD  architectures  for  signal  processing  are  encouraging. 
But,  the  practical  and  conceptual  problems  can  be  solved  only  through  con¬ 
tinued  research.  This  technology  provides  one  of  the  best  possibilities  for 
rapidly  processing  the  very  large  quantities  of  data  needed  to  realize  high 
level,  real  time  computer  vision.  The  problems  of  size  and  reliability 
are  of  the  utmost  importance  if  systems  are  to  be  installed  on  small 
carriers  and,  here  again,  CCDs  offer  a  possible  solution.  Separate  research 
on  CCD  basic  building  blocks  for  signal  processing  is  recommended  if  a 
unified  research  program  is  not  continued. 

The  realization  of  practical  computer  vision  tracking  with  a  high 
degree  of  confidence  is  expected  to  require  a  hierarchy  of  algorithms  work¬ 
ing  together  to  accommodate  the  wide  variety  of  environmental  conditions 
that  can  be  encountered.  The  algorithms  will  include  multiple  solutions 
for  measuring  motion  in  three  dimensions,  segmenting,  edging,  recognition 
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and  capability  of  accommodating  multiple  targets;  and  all  of  this  in  a 
noisy  environment  which  partly,  or  occasionally  completely,  obscures  the 
target.  General  algorithm  work  and  testing  will  undoubtedly  be  a  long 
term  area  of  research,  certainly  in  the  next  five  to  ten  year  time  frame. 

It  is  important  that  experimental  work  accompany  the  theoretical  work. 

A  computer  vision  tracking  and  guidance  laboratory  should  be  established 
to  test  and  refine  algorithms  and  to  help  delineate  the  problems  that  can 
be  discovered  only  through  hardware  experimentation.  The  laboratory  needs 
working  systems  and  target  simulation  capability.  We  have  reached  the  first 
performance  level  with  our  experimental  system,  but  the  components  were 
originally  built  or  acquired  for  manufacturing  automation.  Equipment  de¬ 
signed  for  this  specific  problem  is  needed,  including  a  dedicated  digital 
computer.  The  establishment  of  such  a  laboratory  is  recommended  because 
of  the  fundamental  importance  of  small  conputer  vision  based  tracking  and 
guidance  systems. 
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0035 
0030 
003  / 


FTJ4 ,!. 


SUBROUTINE  I M I T 


cccc  ccccccccccccccccccccccc ccccccccccccccecccoccc CCCCCCCCCCCCCCCCCCCCCCC 
cccccccccccccccccccccccccccccccccccccocccccccccccccccccccccccccccccccccc 


0{-3B 
0039 
,•••,  ■•/!:; 
004  1 
•0*42 
"■043 
■1044 
0046 

0040 
004  7 


THE  PURPOSE  OF  THIS  ROUTINE  IS  TO  l/iAn  CONTROL  CONSTANTS  FOR 
THE  INTERACTIVE  TRACKING  SOFT RARE  PACKAGE.  IF  ANY  NON-NUMERIC 
VALUE  IS  ENTERED  FOR  THE  VARIOUS  RF A D  STATEMENTS*  THEN  THE 
PROGRAM  WILL  DEFAULT  TO  THE  .GIVEN  VALUES. 


SOURCc  FILE: 
OBJECT  FILE: 
CALLED  BY-* 


INI  TS 
INITR 
MAIM 


I  START 


STARTING  ADDRESS  FOR  CAMERA  WINDOW 
IN  X  DIMENSION 

STARTING  ADDRESS  FOR  CAMERA  WINDOW 
IN  y  DIMENSION 

STOPPING  a noRESS  FOR  CAMERA  WINDOW 
IN  X  DIMENSION 

STOPPING  ADDRESS  FOR  CAMER A  WINDOW 
IN  v  DIMENSION 
sgcmc  DISPLAY  or>xiof! 

IDTSP=2  DUmd  DATA  ARRAY 
I DTSP=1  DISPLAY  PACH  SCPNE 
J0TSD=-'  MO  ou°'JT 

MAGNIFICATION  F ACTnP  FOP  DISPLAYED  SCENE 
X  ADDRFSS  o»  TPKTRONTX  DISPLAY 
v  ADDRESS  ON  TEKTRONIX  DISPLAY 
ncppTVA.TTVc  DISPLAY  ORTInM 
IVTC'-j-j  DISPLAY  OPRRIVATIVFS 
T  V I E  •.  -0  NO  0UDUT 

OFRRlVATlVE  COMPUTATION  opxinu 


JST*  RT 


WINDOW 


I  STOP 


FOP  CAMERA  WINDOW 


JSTO? 


WINDOW 


I  LISP 


I" 

J0 

I  VIET 


IiMiPT 


I  ;'.nn-p-| 
I  7107=0 


WITH  AVPRAOING 

normal 


I  'ove 


*UXOM ATIC  CONTROL  Of-XION 


I  ?'A  X 
J.’AX 
I  CCiD 


T  'OV"=2  CI.OSP.il  l.ooo 
T  ’oyp=i  auto m a  rj c  TARGET  Mf'VFMEHT 

i  ?<v./E=-i  NU’UM  comtRoi. 

'.'■■J’XER  of  S A 'Xl.ES  -IN:  X  ni»!p'SloM 
•■pr'KER  OF  PAwr>l.ES  fM  Y  HIM-FNSIOW 
PtaL  N'l’M'PiJ  OF  0A'"PI.ps 


(:cccccaxccocccocccccocccccocccc-''ococorccocccoocc':cccccccococococcocccol 


ccca.ccc; 

c. 


CG  CCCCC,''GCCf'CGCCCCr'CCCCCDCC"'('rocCCCGvOrcCGCCCCCCCCOCCC(?CCCCCCOS 


I  — twig:, 

I ::  f«:=r 

ir.TPGPR 


I  ST-w-T,  !S’P'JT.  I"7or>,.toxnP,  •  C'ND'T.  T”AV.  J‘'av.  1  %  Trn.s? 

JOf'S i  ,  Jr*??,  ln  p-'V,  IDF?,  I VTt  ",  I-.OP7,  I  'f-VE.G  «A.r,F,jn 
ISTF.-l  ,  I  PTE  P2, 1  DIR,  ons! ,  roe? 


•oti.eR:  pro  -’7  (pp FT.  !  c'/4) 


.H'-OS 

.Wo  9 

-W60 

3361 

0062 

'4063 

0064 

IW-OO 


0067 
■0068 
006  9 

mi\ 

0012 

0073 
0374 
0075 
00  7o 
0077 
*378 
007  V 
00H0 
00  s?  1 
•:v82 
0093 

0.384 

WiO 

00H6 

'.'.087 

0083 


CO  V‘0'1  JR0S1  ,JR0S2,  TO0F.V,  IDIS?,  IVIE./,  I00PT,  P'OVF,P>'A<?,  10,  J0 
COf'iW  ISTEP1  ,1?  FP?,  I  DIii«P*Sl  ,D*32  .  Q 


ISTART=l  ' 
JSTM<T=1 

IS7np=oc 
JSF»P=90 
IDISH=o 
P:  A0=2 
I  •:■=•' 

Jo=* 

I  vie. •;="■■ 

inow=i 

I‘‘OVF=0 

I00RV=l 


WRITE  (1,100) 

FOR  MAT ( " ENTER  D  FOR  DEFAULP* ,//) 


WRITE  (1,200) 

FORMAT  ( "ENTER  ISTART,  JSTAPT,  I8TOP,  JSTOP" ) 
RFAO  (l,*)  ISTART,JSTART,  ISTOp.JST*? 


WRITE  (1,300)  I 

300  FORMAT  ( " Pf.'TFP  DISPLAY  OPTION:  0  liO’iH:  1  DISPLAY  PICTUPP:  2  DUMP")! 


RF* 0  (1,*)  IDI3P 
IF  (IDISP.NE.1  )  00  pi  400 
IF  (IDISP.MS.l)  00  TO  500 
WRITE  (1,400) 


vwa  9 

400 

FOR**/ 

0.090 

REAn 

00  91 

boo 

IF  (IDIe! 

'•0  92 

i.RIT- 

•4093 

R-A!: 

'■■094 

600 

pH;- "! 

0095 

Rc  \r- 

:■:-/•  96 

r 

0.0  97 

70.0 

•WHITE  (  1 

00  98 

800 

For' Af  (! 

00  9  y 

HE-M)  (i,- 

■0 1  •'*  •? 

/  » 

01  ’1 

..RITE 

41 .02 

900 

FOR  'A 

.:i  ;j 

RFA.o 

0  1  .-4 

C 

l ,  1  lo 

;.H  ITE 

■  1  ■*?' 

I'M 

FO.»  */.' 

01  17 

HF '  .j 

.’l  Hi 

c 

:i  9 

HR  I  TE 

■  ’1 1  • 

11-  • 

FOi.'A 

0  111 

HF  •*•  ij 

•112 

r 

r'  V." 

’  1 1  ? 

..HI  F 

!  14 

1  2  •  1 

pf>.;  •«■ 

1  1-; 

•  1  i  o 

C 

oil/ 

IM*-X  = 

:  i  i  ^ 

II 

*  < 

:  ■.«-j  pqj  FT  14  CJVOJI.cm:  t:p;Mi77  (^PIT.  1974) 


•%„  •"Stf-  'JW-  •***=*  - 


««31 

0003 

0304 

0005 

.'■■’MO 

0007 

j-wob 

r.HV.1 9 

0010 
00 1 1 
00  i  2 
00 1 3 
0014 
00  Id 
00 1  6 
001  7 
00  Id 
00 1  9 


:JAGE  0001 
FTTM.L 


FTH4  COMPILER:  v?2*\Tt  (SFPT.  1974) 


S  UI-’  ROl  IT  I  * ' '  E  UT I L  (  I FL  AH ,  ?  I C ,  0!  P ,  01  .  .02 ,  !iE  A« .  0 ,  PC ) 


CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC0C0CCC0CCCCCCCC0Cr0CCCCCCCCC0CCCOCCCCCCCO| 

cccccccccccccccccccccccccccccccocccccocccccccccccccccccccccccccccccccccoj 


TI:R  PJi-.-oSE  OF  THIS  ROUT  I  HR  IS  TO  PERFORM  GENERAL  OUTPUT 
OPERATIONS  IF  THE  TRACKING  SOFTWARE  PACKAGE. 


SOURCE  FILE: 
OBJECT  FILE: 
CALLED  sy : 


UTILS 

UTILR 

COMT 


THIS  ->ROOR.\v.  CALLS  THE  FOLLOWING  SUBROUTINES: 


20 

cc 

SORT 

0021 

cc 

i.’SCT 

,.!i'22 

cc 

il.oAi 

N023 

cc 

:  .  i  y 

0024 

cc 

LIST 

0025 

cc 

0026 

cc 

I  FLAG 

0027 

cc 

d  1  0  :;*2 

0028 

cc 

IDISP 

D029 

cc 

0030 

cc 

-•031 

cc 

P  -I:!  P: 

•• 

cc 

PIC 

0033 

cc; 

*•■34 

cc 

0036 

cc 

IrOSI  •* 

•:?2o 

cc 

J  FOG  1  . 

0.=37 

t>r> 

I  J 

;  -‘3^ 

•■>(■ 

-D3V 

CC 

>  » 

cc 

.  !-•' : 

"■  -4 1 

•. :  4  2 

/  V' 

■  ■ '  4 

OCCCCCCCCCG 

4  4 

CCCCCCCCCC-: 

.:.4*j 

c 

’..v4o 

C 

■:  4  / 

.*  M  '' 

r  TTL  . 

. .  *4  •/ 

V  i"GE‘ 

.6.1 

i  •iv::r:i:;i 

;6  1 

N( 

‘  :cy  ; 

J''1  ■  'O' 

\*  **~4f 

-% 

co.  "O  '  r 

J 

*  *^.0 

READ  DATA  ARRAY  FRO?!  CAMERA 
REPACKS  the  CAMERA  DATA  AR°AY 
PERFORMS  TAR opt  /  BACKROUMD  5E PAR ARTIOM 
STORES  r>TcRIOR  TAPG~f  PTS  TO  CREATE  D 
CREATES  DFRRIVATIVE  ARRAYS:  ^C  ?■  G 
OUTPUTS  DIGITAL-  IMAGE  -ON  TEKTRONIX 


SCENE  INDICATOR:  1  INITIAL:  2 -SECOND  C0| 
N  X  1  ARRAYS  CONTAIN  no  TARGET  POINTS  cc| 
OiJ'P’JT  CONTROL  VARIAFL17:  1  DISPLAY  I  ’'AGE  CC| 
2  0'J"P  SECTOR  of  rv.nct  3  DISPLAY  IMAGE  CQJ 


I  FOS2 
J  r002 


WITH  TARGET  BLAMING 

PA!’gp  of  VALUES  I"!  DATA  AR!>AY 

TM-nnnp  OAT A  ARRAY 

4  v  j  "array  CONTAIN  I  mg  LOCATION  OF 

SECTOR  to  rp  VIE ''ED 

TARGET  o^ojECTJo^  oh  Y  AXIS 

TARGET  PRojc^i* j n*t  nv  y  AXIS 

'y'  !/V};>  CONTROL  VAP I  A  DIPS 

Afp \y<;  on  •.■.■ninrfED  AMD  UMWFIGOTcp 

SPATIAL  :''S‘P  I  v  AT  I V  ES 

INTENSITY  OF  data  ARRAY 


CCCCCCCCCGv^'C'.-CCCf.CCCCOCCCCCCCCCOi'CCOCCCCCCCCCCCOCC-  :cccccccccccrcccccc 


i  • :  r:P  1  , 1  ST':  :R' ,  r •  1 1* ,  'OS  1  ,  K>SR ,  I  pns ,  w DOS ,  I ,  J ,  •>  I C  ( 1  "0 ,  ]  ) 


O  ‘-:y,  [  ^  I G ,  IV  I  IGO^T.  I'OVE.i 
.  tu„>  .o<:  1  _  .:n-y 


”AG,  I**,.?'* 


JMd/ 


r'A'-E  ■’02 
,.C».  t  '. 


UTIL  FT<:4  CV'^ILER:  t;.-?4177  (SFPT.  1  «7-*) 

« 


0(360 
666 1 
•:wo2 
06  0j 
oeo-4 
0065 
0666 
006  V 
<  >068 
'•069 
03/0 
0071 
0072 
0073 
0074 
0075 
0076 
0077 
0078 
0079 
0080 
0681 
0032 
0063 
0064 
0085 
0O3o 
6037 
6088 
'•>069 
6090 
0091 
0*092 
0093 
009/i 
009" 
0090 
0097 
0096 
00  99 
B  i  CO 
0  l  0 1 
0102 
0103 

v)104 

iit-50 


■  •-  f(  •■■•  ■) 

second  scene*  STORE  TARGET  ooriTS  .  A~12 

IF  <IFL\G.E0.2>  CALL  ni.O\n(  PIC,  02) 

Mi^ST  SCFNRs  SEGMENT?  STn°E  TARGET  POI'iTSs  CALCULATE  DERR IV ATI VES 
IF  (IFLVVi.E.l)  op  TO  I  "•  o 
CALL  R  EOT  (PIC) 

CALL  L'LOAiXPlC, Dl  ) 

C A  LL  DE-iV  ( fI  C .  0.  PC ,  '< ) 

• 

jju-o  sector  of  oat  a  array 
IF  (IJISP.CE.2)  00  TO  7'V 
..RITE  (1,200) 

WRITE  (1.200)  IP0S1 .IP0S2.JO0S1 ,JpoS2 
POP MAT  (4 Jo) 

00  600  I  =  !>*) MP  ( 1  ) ,  DU,J?  (2 ) 

DO  400  J=D’JMP(3)  ,D!JMP(4) 

WRITE  (1,300)  PIC(I,J) 

FORMAT  (1016) 

continue 

WRITE  1 1,500) 

FORMAT  (//,"RO-i  «,I6) 

CONTINUE 

CALCULi’iE  RA?iop  ON  PIC(I,J)  P:  opOEP  70  DISPLAY  I?'A(?E 
IF  ( IJIS°.:!E.  1  )  C-o  TO  900 

P?'AY=1 

DO  300  I  =  1.1  MAX 
■  <r\  1—1  imaV 

IF  (  PI C  ( I ,  J)  •  LT.  P‘!  l?-: )  0'*lHa0lC(I,J) 

IF  (PIC(I,J).CT,PV*X)  PMAX=PIC(I, J) 

TARGET  BLANK INC 

IF  (  IDISP.UE.3)  GO  TO  M'-'O 

P?'IM=o 

T F  ( ( ( I .  LT .  I  pos  1  ) .  AM D.  ( I .  GT.  I P0S2  ) ) .  AND,  ( ( J. LT .  J  pop.  1  )  .  AND , 
+  (J.GT.JP0S2)))  °I0( I , J)=0 

CONTINUE 
CALL  DIS P( PIC) 

CONTINUE 

rfTUipi 


ir./ijORS  *'*  fROCRA'-  =  0  31  ’ 


COMMON  =  '-ioo.i 


p.AC-E  ;»M3  UTIL  F T : 4  COMPILER?  HP241 77  (3UF'‘.  1W4) 


;:r'o 


ENDS 


mm  i 

0002 

0O03 

0004 

0006 

0007 

0008 


PAGE  0001 
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F'fTM  COMPILER*  HP 2^ I  77  (SFFT.  1974)  A_13 


SUBROUTINE  SORT( PIC,  MEAN)  ‘  | 
C  1 

c  1 
cccccccccccccccccccc  ccccccccccccccccccccccc cccccccccccccccc^cccccc  cccccc 
ccccccccccccccc  ccccccccccccccccccccccc  cccccccccccccccccccccc  cccccccccccc 


0009 

CC 

0010 

CC 

0011 

CC 

THE  PURPOSE 

0012 

CC 

ARRAY  IN  A  : 

0013 

CC 

THIS  IS  NEC! 

00 1 4 

CC 

MATCH  THE  F 

0015 

CC 

INTO  ITSELF 

0016 

CC 

0017 

CC 

SOURCE  FILE 

0018 

CC 

OBJECT  FILE 

001  9 

CC 

CALLED  BYs 

0020 

CC 

002 1 

CC 

PIC 

00.22 

CC 

I  :  AX 

0023 

CC 

J‘  AX 

0024 

CC 

I COUNT 

0023 

CC 

I?OS  JPOS 

■■)  •■•52  6 

CC 

I  J 

0027 

cc 

MEAN 

0028 

cc 

.'■J029 

cc 

0030  c< 

003 1  C 
0032  C 
0033  C 
0034 
0035 
O03o 
0037 
0033 
003  9 
00  40 
004 |  ‘  C 
■.504  2 
.5043  C 

0044  c 

vJ-04  y 
.5040 
•)H4  7  C 
0,;48  C 
004  V 
•:-0o0 
0051 
0«52 
•'•('•o3  C 
0C54  C 
.•■055 
".5o 


■0057 
0058 
005  9 
Wv?O0 


CC  SOURCE  FILES  SOPS  *  CG 
CC  OBJECT  FILES  SORR  •  *  .  "  S 
CC  CALLED  BYs  MAIM  .  C| 
CC  CO 
CC  PIC  INTEGER  DATA  ARRAY  Cg 
CC  I’  AX  NIPPER  OF  SAMPLES  IT'  X  DIMENSION-1  Cd 

cc  j » \  x  mu’!3er  of  samples  ip  y  dimension  eg 
CC  I COUNT  TOTAL  NUMBER  OF  SAMFLES  ■  CG 
CC  I^os  JPOS  PO I ’ITERS  TO  THE  LOCATION  of  next  ei.fuent  cj 
cc  I  ?  J  DO  LOOP  CONTROL  VARIABLES  C| 
CC  mean  :icAN  INTENSITY  op  DATA  ARRAY  C«j 
CC  cd 
CC  C;| 
CCCCCCCCCCCCCCCCCCCCCCCCC  CCCCCCCCCCCCCCCCCCCCCC CCCCCCCCCCCCCCCCCCCCCCC^ 
CCCCCCCCC'DCCCCCCCCC  CCCCCCCCCCCCCCCCCCCCCC  CCCCCCCCCCCCCCCCCCCCCCC  CCCCCf|| 


INTEGER  I  START,  JSTART,  ISTOP,  JSTOP,  TCOUMT,  IHAX,  JM.AX,  IP^Sl  ,  LFOS2 
I  ■ :  TCfJEK  JPOS  1  ,  J  pos  ? ,  I  oncy ,  ID  I S  P.  I V I  EH,  I  OORT.  T  MOVE  ,P’*AO  .  I 0,  J-*5 
I : rr-GFR  I  STn  P l  ,  I  ST~  P2 , 1 01 S ,  pos  l  ,  o.nsp ,  I  one ,  JPOS  ,  I ,  J ,  PI C ( 1  ,  1  op ) 

REA i  -cau 

CO  “  O  !  ISTART,  JSTART,  IST^P,  JSTOp.  ICOIP’T,  I*'AX,  JMAX ,  IpOSl ,  I -053 
CO  "'O’!  JPOSI  ,  JDOS?,IOOEV,  IOISP,  IVI^l,  IPOPT.  r.'OVE,PMAG, I", JO 
CO  '  ■■O’!  I STE  Pi  ,  I  FTP  P2 ,  I O I R  ,  POS  1  ,  OOS2 

f;  \  '*=^i 

S=T  rO  INTERS  to  LAST  ELEMENT  IN  FXISTINO  ARRAY 
I  r-'\S=ICO:JMT/l  (•■■'*■*•  1 
j;^E=K:ni):,  p-1  IPOS-1  ) 

IF  ! doINT^r  »:Oj’.M.S  /.r'\n  Tl,r:*l  RESET  IT  TO  loo  AND  DFCRE”F?'-,T 
C0LU"i  POINTER 
IF  (J.ns.OT.O)  00  To  1  -'0 

jpOS=lP/i 
I  P00j=  IPOS-1 
ic-  cn>  rr:U’; 

,;E' : I li  REPACKING  FRO"  LAST  ^LE’-EMT 
!;0  2-  '  J=j:.;AX,  1  ,-1 
uO  2-  1=  I  ‘AX  ,1,-1 


sow-f 


f’P’4  CO'VIL®;?*  HP24177  (SEFT.  1  ?74) 


;.'*s an='-E A”  +FLO  AT (  PIC ( I ,  J )  / 1 COUNT) 
PIC(I,J)=?IC(JFOS,IPOS) 

DECREMENT  ROW  POINTER 
JPOS=JPOS-l 


A-15 


OCO  I 
0«:'i2 

CYW3 

•.'£}£14 

■'■O'/.Q 

rou7 
:$co8 
c^oy 
M91 .1 
«jw  1 1 
m\  2 

Oil  I  3 

BlU  * 
O'- 1 5 
Ml  6 
•Ml  7 


PAGE  f  i 
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FIRM  COMPILER*  HP2*1 77  (SE°T.  1  97 A) 


n  % 

W 

C  1 

SUBROUTINE  wECT(PIC)  1 

C  ■  1 

C  I 

cccccccccccccccccccccccccccccccccccccccccccccccccrcccccccccccccccccccccg 
cc  ccccccccccccccccccccccc  cccccccccccccccccccoccc  cccccccccccccccccccccccsi 
cc  Q1 

(VS 

THH  FUR  .-OFF  OF  THIS  ROUT  IMF  IS.  TO  PERFORM  TARGET  SELECTION  c| 

an;  S-Of-.F?TAT I OM  OM  T-iE  OASIS  T*JA7  T“E  TARGET  INTENSITY  DIFFERS  t% 
FRO1'  THAT  OF  T^E  SACK  ROUND.  S0‘*  AND  COLUMN  SUMS  ARE  CHEATED  CC 

FRo.’;  T1? E  INTEGER  DATA  ARRAY  AND  EACH  ARE  EXAi'INPD  pop  TU£  IPO  CS 
GREATEST  PI  FFFRETCES  .VHICH  I  MO  I  CATE  THE  POSITIONS  i'^ESE  T^EPE  CG 

IS  fuc  GREATEST  TRANSITION  FROM  paCNPOUNH  TO  TARGET.  MTJ  T'-SE  CC 


CC 

CC 

CC 

CC 

cc 

cc 

cc 

cc 


r-o:j?ii'S  ON  Tii"  HORIZONTAL  AMD  VERTICAL  o=  fuc  TARGET,  2"  DATA 


=01  o 

cc 

POITiS  ARE  SELECTED 

P’  THC  CEI' 

m\  v 

cc 

r-VHGET  R=om*i.  THIS 

ALGORITHM  - 

/.,2' 

cc 

A';:?  7; v  THE  TARGET 

“AS  FAIRLY 

:-.2-i 

cc 

CC  22 

cc 

SOURCE  FIL.Es 

REGS 

■r/.23 

cc 

OBJECT  FILEs 

PECR 

0.-524 

cc 

CALLED  MY t 

maim 

OD2= 

cc 

(-?<  12  c- 

cc 

TilS  PROGRAM  CALLS 

THE  FOLLOaP 

Bl-27 

cc 

ZE’- 

to  i»ir 

0028 

cc 

S! ' " 

ex  a  .t?:e 

V.S12V 

cc 

LYC 

TO  ORDE- 

Dli.-C*. 

cc 

S=T.-CT  • 

0031 

cc 

■G.:32 

cc 

riC 

integer 

OS' 23 

cc 

Ir'AX  ' 

:<U*«ER  • 

J-i 

WNrf 

I » -  *  V 
■  -  -  • 

•  HJMPCp  ■ 

•  ■  j- 

IS-j  •  ?.  .ISii  -s 

M-T.-:  AND 

•.Mo 

cc 

im.Si  I  r>r.;:  ;> 

-•Ml'. c-r 

•-■3/ 

CG 

J'-OSl  "  .P OS? 

faij-ltri' 

i3h 

cc 

I  -  J 

no  1.00? 

cc 


rc 

r *n 

6£ 

CC 

cc 

Cl 

c§ 

cs 

cc 

cc 

cc 

rS. 

■» 

0§ 

C§ 

c< 

(X 

rj 

rjf 

CC 

G? 

•3 


•  1 

cor  g?:ccccoc  *c  "coc 

:■ M2 

CC 

ccccco  coco*  'ccc 

c 

c 

*  0  _  « 

• «.  J 

I rST-*R' 

.  Mo 

1.  J-'-'lSl 

■  / 

iVTn, J«-7=j 

RTC(  1  ‘ 

V 

C"  :  0  l  I'-TART 

•CO  •  ■  , 

•  ■‘-.I 

CO  "DC 

‘‘J 

V. 

i  I  TI  ‘LI/:; 

C'  .LL  ( T-'! 

.’Mo 

C'LL  ZS:(.TSC  . 

' !  ■•:-! .  I  S'  *PT.  T  **W=  .  ^  ao  .  I  * , .!  ?  . 


’  A  V” 


T  »:•  V  1  \ 

♦  *  / 


/ 


.'C"'T  1  •'T  1  % 


if* jSfkfc- - 


s^sw-'^Srs-v  ag&g^^a^Ba^gaggs^Bssssa 


(•.''/>  D  7 

C 

00  5  6 

C 

CRFATF  HO1,.  SUM 

ousv 

|)0  l-,o  1  =  1  %  I ‘-f A X 

(Voo 

DO  \W  ,1=1  ,  JUAX 

0061 

ISU“((  I  )  =  ISIJ.M(  I )  ^PIC(  I 

('062 

1 0M 

CO  ill CUE 

0  -'o3 

c 

0064 

c 

CREATE  COLU "N  SIJM 

OOOD 

i)n  2i'n  .1=1  ,  J“AX 
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ijO  2-r  I  =  1,1  "AX 

••'•(’67 
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EX-vlUE  RO AND  COLLJmM  VE 

■'071 

CALL  SU'*(  I  SUM,  I  MAX ,  I  POS  |  , 

••'072 

CALL  S U M ( JS U : , J *’ A X , .IPOS  1  , 

.10-73 

r 
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C 

SELFCT  COOR DI NATES  OF  20 

077d 

CALL  LOC 
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0078 

c 
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CC 
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CC 
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CC 
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CC 
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CC 

SOURCE 
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CC 
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CC 

CALLED 
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CC 
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LO 

V  FCT 
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cc 
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cc 
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P0S2 
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cc 
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0023 

cc 
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0024 

cc 

I 

O'. '23 

cc 
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cc 
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VECTOR  cnrTATUlMO  SlH‘!1ATIOM?  <T; 

HiJUBFROF  P!.P-«'!TS  If  THE  VECTOR  CCS 

POTTERS  TO  THP  TWO  Op  FA  TEST  DIFFERENCES  CC, 

VALUES  OP  T,jF  TWO  GREATEST  DIFFPRphCES  CC? 

VALUE  OF  PJP  CURRENT  DIFFERPHCE  CCf 

Co  LOOo  CO  S’ TP  OL  VARIABLE  CCj 
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•\::pr 

•J  1 

' 

l:;  (G!-.*- 

GM'l 

‘J  t 

■'  .1 
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IF  (  IrOSI  ,'T.  I  rOS2)  CO 

o  M2 

IT"  '‘2=1  r 'c  1 
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U’Mo 

JTF;,P=JPOS  1 

C4  V 

JP0S1=JP0S2 

•  '•/,  5"! 

J rOS  2“JTFF  P 

'.'•3b  1 

C 

'/‘•4b2 

c 

CALCULATE  .'•.TopofM-rs 

>•.'1)3 

f. 

I  -ft:  ,op=(  J  pop  1  +  I  one p )  /  p 

•'•'b-i 

J  IF  T=  (.IPOS i  +’ROcp)/p 

'"'bb 

C 

■  ■‘•bo 

c 

( I  pn~i  >1  pop?) 


I 

3* 


1 1  :it 


mr:s>  ^Of 


*:yv.  ''-MnfTr:.,.  ::r  0*  |  77  (ft:??.  l*/?'1) 


OM.O'.jLa’P:  •■!)••!  ftu  n:  r^T'”fq  p; 
?'  .  •  1  —  '  .i  i 


! 


2v.  _ 


A-21 


PAGE 


■.'•••oi 

FP.'4,!. 


FT”4  COMPILER:  ’-ippat  77  (SEPT.  1974) 


1 


1 


SUinoLTICP  0!.O  \0(  PIC,  O) 


ccccocccoocccoccccccccccccccccccocccccccccccccccccccccccccccoccccccccccfl 

CCCCCCCCCOCCCCCCCCCCCCOCCCCOCCCCCCCCCCCCGCCCCCCCrOCCCCCCCCCCCCCCCCCCCCCi 
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THE  PURPOSE  OF  TPS  RO'JTIME  IS  TO  OR  RAT-  A.  SCE^R  VECTOR  T-»AT 
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001  I 
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0019 
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0027 
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0030 
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THE  rUR.-OSE  op  THIS  ROUTINE  IS  TO  DISPLAY  AM  I?' A  OF  op  THE 
I.'TEOEP  DATA  ARRAY  O']  T“>E  TEKTRONIX  4p.|  4  TFR;?IMAL  WITH 
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DEJECT  FILE: 
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MAXIMUM  IH'FOHP  VALUE  TO  BE  DISPLAYED 
UUonpR  op  SAMPLES  IN  X  DIMENSION 
MU “RPR  op  SAMPLES  IN  X  DIMENSION 
MU-RPR  op  SAMPLES  IN  Y  DIMENSION 
J'AON  IFICATJOM  FACTOR 
COOR  DIM  ATE  ^  op  INA.OP  ON  DISPLAY 
INTEGER  DATA  ARRAY 
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cr:  ’‘O’:  !  START.  JSTART,  IS70P.  JSTOn,  ICOijoj,  p/>X,  J?'AY,  I  Po?l .  IPOS2 
CT  *'o  !  JROSl  ,.JP0S2,I0:'EV,  miSP.  TVP',  IDopT,  POVE.r’^O,  P.Jo 
CO-’OM  I  TOT  ,  I  STEP?,  IDIi\  POSl  ,  POS? 

1  A  oM«y/i03>>.i,  1  6M'\  |  A°.  C.-\ ,  1  7920,  1  ^4.32,  JHC44, 1  0456, 1  996B, 

1  2'/R6,21  PM,  2  3  04 '*,'*1  92.10752,161  2lV 
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C 

0040 

C 

C!,s:C”  C^  :T;r,L  VVfl  .*P.LnE  Apt: 

H04  / 

c 

D"-\'  iPj:  i  Er AULT  VALUES 

0049 

IP(  'JV?.  )  pA0=l  . 

v»::-4  y 

IF(  P.  OR.  10.  1  -?4)  p=l 

■M’Ov' 

IFtJ-'.L-'.-.op.  Jo. op.  l"74)  j^=| 

000  1 

c; 

0  0)2 

r* 

V«:-.-lpv  ~  I  vp  op  iJS^LAY":'  PAGE 

■'•'53 

I  =  „P  '.- 

!'-••!•’  '•(  I  .  1  •  *  p  1 )  —  I 

.  *  *►>*•> 

.)•  =  :v-' 

.’•opo 
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rA<'E  * )ISP  PT'o  00 'PT Lr:R : 
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005y  jo  ioio  j=jM.j..'.t2 

0060  JI  =  ( f'O D(  ( JM+JO- J+ 1  ),  32  )  +96 )  *256 

0061  JH=( (JM+J0-J+1 )/32+32)*256 

>')062  UO  1000  I=Ir\  I1', 2 

0063  I L=  ( .von ( ( I-l  )  ,32)  +64 )  *256 

0064  I *-'=  <  ( I-i  )/32+32)  *256 

0066 '  I  m=  ( I- !  m  )  /n  >'A o+ 1 

0066  j;;=(  j-jo)/p»‘AnHi 

00 o 7  I?=(  I.jr<(I:'!,JM)-Pf‘I'‘,)*16/(D7A:<-D?»lM+j  ) 

00  Ob’  IFUk.ot.15)  I  P=  I  5 

006  y  IFUF.LE.'*)  goto  1000 

•4070  ..RITE  (15,1  )  G9AY(IP),JH,JL,IH,TL,24320 

0071  10O'i  CONTINUE 

0072  C 

0073  rtttITE(I5,l)  7  936 

0074  C 

0075  RETURN 

0076  C 
O077  C 

0078  END 

**  mo  errors **  program  =  00349  common  =  o°>o2/i 
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l-.'T-  \u‘n v  use  tjs  n^p active  vir*co  tpacktuc  software  cc| 


SOURCE 

OBJECT 
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I  .-•'"  1 
"'•'FI 


FILE* 
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HEPS  ‘  CCI 
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INTEGER  0A7A  ARRAY  C(| 
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:  •  I  '-700 1  ,  r 5; T,:~  M  I T » ,  poo  t  ,  pos  2, 1 1  . 1 2 ,  1 3 .  PM  5 ,  T  n ,  I  7, 1 ,  .J 
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C 

IV '7 IV"  ysi”o  T1 

1  •  '• 

I! = 1 4 1 

••-'72 

I  P=J 

v*73 

i:-:=i-i 
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c 
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■'•’.62 
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i-3 ( \ ,  2 )  =  (  I- 1 ^ -.K 

b 

•  N 

V.560 

3*.  *' 

■  •■?■/ 

cf 

<  •’  H  4 

r 

:*  :hv 

IK  c  I V  I *-  1  )  00  Tn  7-*' 

;•••:■  V/= 

r 

:  v! 

C 

OLY/JT  T£:>yi^.vfI7i=  CM.OU 

■  92 

..hi  te  c  1 ,  ••') 

v3 

(  1  ••)  (('5(1, .!},.!< 

-."V4 

.61  Tf:  tl 

H’  vb 

..?< ITF  (l,b'-4)  ((JC(I,.n, 

’  'VC! 
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•  v7 

> 

.-'•'"AT  (2.  :.?> 
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O'  s  ‘ 

1-°:;  “•  f  (///,-,r'C  a,  vi«,/ 

■  1  ’  •■ 

/  ' 

:V  F  i  • !  • : 
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C 
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1 .  *  *  1  *, 

XX 
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A-27 


-A  Or 


.  VyAJ 

•.o:»2 
C'-"<3 
(.•.;■■;  a 

5 

*.HV!o 

(.007 

'W.Vlp 

«  .*  *Jy. 

t'lW9 

ooi:-. 

o-o  i 1 
0012 
iJPl  3 
ooi  a 
OP  lb 

017  1  o 

wt  1  7 
«?  I  li 


■•  -.'i| 

FTTM.L 


FT'IA  COMPILER:  ’IP24177  (SFPT.  1974) 


C 

r> 

V^ 

c 

C 


W 

i 


Sli-'POUTI-'r  —■  \-ys  ( v.  ->C,S,  SCALE .  Pi  , P2, A ) 


cccccccccrcccocecf'ccccccccccccccccccccccoceccocccccrcccecoccccccccccccco| 
cccccccc  ncccroccoo- 'occcccocccc  cccocorcccccccocccccooc  ccccccccccococccccc | 


:c 

cc 

cc 

cc 

cc 

cc 

cc 

cc 

cc 

cc 


CCJ 
Cr'l§ 

Y>:n  p-jwons"  np  THIS  ROUTINE  IS  TO  solve  T^E  TSVIR  ALOORTTHf  ccf 
for  THE  AFFI;!~  PARAMETFRS  IISP-IO  T«E  PSEUPO  P1VFRSF  (A  =  OCT  *  D)CC| 

cc| 

TRACS  .  -  .  CCf 

TRACK  -  *  CCf 

CO'-T  ‘  CCS 


SOURCE  FILE: 
OI-.R-CT  FILE: 
C-M.L pc  sy : 


f-’IS  ■»;>n*5k AM  CALLS  THC  FOLLOW  pio  ~>o:j  TIDES 


•■'01  A 

CC 

CREATES 

nc>2r 

pr- 

■ :  r'Y 

CREATES 

0021 

CC 

0022 

CC 

A 

X  1  A 

V-023 

cc 

i.C 

A  l;P  AY  C-O 

0024 

cc 

ij 

ARRAY  OF 

.'‘.’■2^ 

cc 

rC 

ARRAY  OF 

002n 

cc 

1C 

H1J.T-1HR  o; 

■  '•-•:27 

cc 

i  ••.  j 

do  :.oo^  . 

;-023 

cc 

SCAI.E 

SCAI.E  F*1 

*  ^ 


O' 


$ 


••02  > 
v-3  ’ 
•■'•31 
‘•’32 


a  x  I  ARRAY  co'JTA  P’l'io  t>jc  AFFIMH  coefF.COI 
'SEO  OF  rC  A  C.o  f>  Cr'| 

ARRAY  OF  IPP.^IOUTEn  SPATIAL  OFRRIVATIVFS  CP? 

LATIAL  OPRRTVATIVCS  CCl 

>01  MTS  pi  T'poc:r  cc| 

'T^oi  V  A  R I  A  o  I  —  ~  C‘i 

>p  to  pnpiiCF  spj’sitIVITY  TO  CCS 

MOT^C  £p| 

cc| 

r»r?l 

ccccccccccccccccccc^ccccccccccccccccccccccccccccrcccrccccccccccccccrccccl 


cc 

cc 


33 

coccc 

dccdoc  ooDco'y'  "oo cccoccccccccoco 

30  jo. 

I*' 

■103:: 

c 

•V3p 

>•■"■*  L  *  ^D(2'*•.4),0CT(•',*.2•,) 

.'037 

if n  o.  , c ( 2 '•* .  ?. ) . . > i  ( ?n ) ,  02 ( ?/ ■ ) , n ( , 

:•'-•  3- 

0 

0-3v 

»> 

5C •?.!;■  i:2  r'Y  p-'E  L  lo;=T  C^Ri^OTP 

«:r-  i  •'*  l=i.5c 

•i.il 

..2(1  )=!V<  I  )=SC.M.n 

.  V  •-.< 

1  ■••• 

n  "ijE 

r» 

•  •■ 

/' 

•  , ’i ‘T*:  sc,:;!?:  )I  FFF:‘c:*of:  vrOP' 

.j:  V.  *J 

CA!.!.  s.r-  (02,01  .O.V',  1  ) 

•'♦O 

c- 

-'4  / 

c 

i .O'-  0.  'ATRP-'  00  =  l  rr  :  *'• 

■  »  #  *  ^ 

:>o  •  1  =  1  p; 

*  !4 

• 

Jl 

*.  *-  1 

•  0  (  I  ,  . J  )  =  rC  (  I  ,  . }  ) 

*•  V 1 

'  0<T.P*-1)=.;(!,J) 

CO  i'l 

;  '  r 

•  !  » 


”■  !.  (  ■:.  c r,v. i  p'u  •?) 
•  PCCT.-^.a/,!) 


:=T-:n  r  \  >a  "n:TFyS 


■  >?c  .■■>•,>  TJ*C'‘  =T'-A  C-o"r>T!  c-j#  77  (?FyT.  197/) 


l 

1 

s 

I 


JS 

M 


PAGE  «001 


FTI4  C0"oi!=3s  »«P241 77  1  c?/ ) 


OKt?| 

0002 

9903 

.;094 

iWffU 
9000 
DC  a  7 
9906 
0009 

no  1 0 

OG 1 1 
wKl2 
0C  I  3 
«:(•)  I  4 

00 1  5 
{ic'l  o 
{•101  7 
00 1 8 


F  1*4.1. 


SuF-kGUTI ME  3SFU\>(  MD’\”) 


cccccccrcccccccccceccccccccccocoooocccccocc~occcccccocccoccocccocr,cr''.o| 
ccccccccccccccccccccccccccccococccococrorccrococrcoccocococrcoc~cccocc? 
cc  i 


CC  THE  rl'ErOSr  op  PM?  ROUT! \IC  IS  to  r^cAjc  p.rr  cqcyoo  iMwcDpc 

CC  OF  A  ?-"n  STORE  IT  !’!  A=SF:Jo.  Antrim  =  T«y [ T-i-' (•*)*'!  *Tn’: ( * ) 

CC 

CC  SOURCE  FII.E:  PT'S 

CC  OBJECT  FiLEi  PT’R 

CC  CALLED  :<Yi  I'M*' 


OBI  y 
00. 20 
i4f?2i 
C322 
0023 
0024 
002  b 
0926 
0027 
0023 
002  y 
0930 
0031 
0032 
o."33 
00-34 
■0O35 
O03o 
c-v»37 
9338 
•0039 
K040 
094 1 
0942 

0043 

0944 

0045 

9946 

0047 

0046 

094  9 

tU’bvJ 

9051 

0052 

0Kd3 

;:034 

095d 
;  otjo 


CC 

CC  THIS 

CC 

CC 

CC 

CC 

CC  A 

CC  AIR" 


THIS  OHO GR A CALL  7”=  FoLLO.-PiG  P^ilTlMFSt 

Ti??i  CREATES  T*-*e  jra'isrocc  np  t};p  r|VCM  /°R*Y 


’*:JLTI  ?*.  :rS  T''0  A UR A vs 

^pn-.-rp  7 pc  p:ycnqc  op  *  *=OIJA!f-  ARRAY 


CC  APS-UD 

CC  a 


!■>  *  H 


p*p a  -FTEP  APRAVs  01”.  :*  X  ?' 

~R a!is ?0SE  op  ARRAY  p|’».  >’  X  *' 

PSEUDO INVERSE  op  ARRAY  A :  OT”.  O  v  ;* 
EROGUCT  op  MATRICES  A7RV  A>>n  D- 
ryjV'Y  STnp/iop  a.RPaYs  OJ  t'.  f*  V  »•  • 
DpiFUSIO’*?  o c  7HP  arv;.vc  SPECIFIED  ApnVE 


ccccccccccccc  Gcrcccccccccccccccccccc  ecccccocccccrccrercoccc  ~cccoc''cccc 
ccccccccccccccccccccccccccccccccccccccccccccccrcrrccccocrocccccccocccc 
c 


INTEGER  -v» 

HEA  L  *(«*,*•).  ?-7R"  *  PSc:j'>{  ’i .”).«{  W  , *•! ) 


CREATE  TRANSPOSE  op  A  "AT?  IX 
CALL  TI>*HA,ATRV,f{.«) 


/.’ULTIELY  THp  TRAMS  POSE  op  a  a  AM!)  STORE  T-’F  RESULT  IM 
CALL  ,{fY  ( ATRN ,  A, *? .?* .  *»•«) 


STORE  I'-'YFRSE  op  r  jjj  :? 
CALL  I  MV  (  B.'nVw  ,  IF  A I L ) 


:  li:VERSE  ijnns  HOT  FXIST  DETECT  =Rf?ot> 

IF  ( IFaIL.oe.i >  on  Tn  ?o  * 

URl  TE(  i  ,  i ("!’■ ) 

109  POrH'A. V(  "Moi.'-pv  [STENT  r!V-G=") 

Slop 


C  .-.'.ULTIrLY  r  T  IP  yuA'S-opc  .0=  a:jd  cpi;c  Rcpijt  j  tm  AfSHIF 
20  5  CALL  vpY(F,ATR:;,APSE'ji\-i.::,”) 


oAOF  0002  PSFUi)  FTM  09"?!LER:  tsP2 4177  (SEu-.  5  974) 


^  i 


mu.)  c 

006 «  END 

**  NO  ERRORS**  PROGRAM  =  ?W1P,  COMMON  =  OMM 
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0062  ENDS 


1 

2 


A- 31 


mo 1 1 

woo  2 

0003 

v)4 

K-L'iJO 
Ot.  *  5  / 

oc.oh 
'«•■:•)  v 
NORM 
0011 
0012 
0013 
00 1  4 
00  I  3 

00 1  o 
001  7 
Of'  1  o 
001  V 
0020 
O'. '2  i 


HA  GE  ■'•••'••l 


F77I4  CfOniJCHt  HP20177  (SEPT.  1974) 


SUBROUTINE  INV(A,  IA.N,  IFAIL) 


cccccccccccoccccccccccccccccccccoccccoccoccccocccccocccocccccococccccccc  1 
cccccccc cccccccccccc cccccccccc cccccccccccocccccccccoc  ccccccccocccccccccc 1 

CC  CC I 
CC  CC  | 
CC  TOE  PURPOSE  OF  THIS  ROUTINE  IS  TO  FIND  TME  INVERSE  OF  A  .MATRIX  CC  I 
CC  BY  GAUSS  -JORDAN  EL  I  MI  HAT  I  OH.  APPLYING  TO  TV’E  ROKS  OF  THE  CC  fi 
CC  IDENTITY  MATRIX  I  THE  SAME  ELEMENTARY  RON  TRANSFORMATIONS  AS  CCl 
CC  THOSE  MY  I'iHICH  A  IS  REDUCED  TO  T'F  CANONICAL  FORM  I ,  THE  '  CC| 
CC  INVERSE  OF  A  IS  OBTAINED.  PARTIAL  PIVOTIMf?  FOP  THE  LARGEST  '  CC  | 
CC  DIAGONAL  ELEMENT  IS  ALSO  DOME.  CCl 


SOURCE  FILE: 
OBJECT  FILC: 
CA USD  !>Y : 


DO  22 

CC 

*, 

/» 

0023 

CC 

0024 

CC 

2 i; 

CC 

IA 

'.v-2o 

CC 

1  i 

0.02  7 

CC 

I  ro 

CC 

TF‘2 

00  2  V 

CC 

•  ’JO 

CC 

oo3  i 

CCCCCC  cccccccccccc 

> :  *  <2 

CCCC! 

::CGCf:ccocccccc 

o  '33 

c 

*•.034 

C 

'.'•'■'33 

Dl  'ENSIGN  A. ( 

0t'<3o 

n 

>•.//  3  / 

C 

'.'.'id 

IF  *•  I  L=0 

3  9 

•.,•'</ 40 

DO  |.t  L=  I  ,  K 

!.‘=N-L+I 

....42 

•'.  ‘.A  v=  \'»s  (  A  ( L 

”'43 

ISWE-I. 

O' '44 

L  "/.=!. +  1 

,  i<  't/f  .j 

1,0  r»  .i=l,*'/'  , 

!..•*'() 

IF  <  M'S  (A  (.1,1. 

:  4  / 

A  -  •.  Y  =  \!'.S  (  A  ( .1 

;.•.•/!'•. 

IP  ‘  V  l*n. J 

./:4  s. 

i 

’  3  •  < 

IF  (/."av.F-D. 

"  “  3 1 

I.  -'  •  (  L )  =  I e  "•  V 

.  032 

i'.o 

■:  :.pj 

•') 

3  4 

■•(L.  >=\<I«' 

•?  ^ 

*  V  > 

2'.' 

i  =v 

i'.OO 

UO  14  1  =  1,1.'' 

I*  !VS 
nvR 
PSEUD 

All  “•!  X  I  INPUT  ARRAY  '.’.'FOSE  HVFPSE  IS 
DESIRED.  NOTE  A  IS  DESTROYnp  By  ITS 

COLUMN  LENGTH  OF  A 
THC  ORDER  OF  "P-'E  SYSTEM 
Temporary  STORAGE  ARRAY  OP  V  'JOPDS 
TE’'°ORARY  STORAGE  ARRAY  op  N  viords 


•  )  r  •  "■ 


-T.  ■  ,  J  I 


177  rs^r.  l  c?/ a 


A- 32 


MOP  8 

A  ( F.S ,  L )  =-  A  ( LS ,  L )  / A  ( I. ,  I- ) 

v-Jt-’o  y 

CO  1 4  11=1,0 

%!6:^ 

LT= I I+l 

C;0O 1 

IF  (Lr.OT.L)  00  TO  1 4 

CVio2 

LT=i.T-l 

O0o3 

1  4 

A  ( I.S , !  T )  =  A  (  LS ,  LT )  +  A  ( LS , 

L)  *\(  L,  I.T) 

0004 

IF  ( A(.‘V!).FO.'»)  00  TO 

|  on 

mm  op 

L'O  64  I=|  ,  K 

8006 

64 

A  (  i ,  I  )  =  A  ( i': ,  I  )  /  A(  :l . '!) 

OK  o7 

a (  :,!:>  =  !  .'va(;i,‘D 

0068 

DO  32  !.=  1 

006  y 

L,7=lf-[  +| 

0070 

LLL= L+l 

0071 

DO  24  J=I.!J.L 

0072 

• 

lt=;:-.hi 

i 

00  73 

tem?(J)=a(l;i,lt) 

0074 

A  (1.8,  LT)  =0,o 

* 

0075 

IF(J.EO.LLL)  A(L’<,LT)  =  I 

.0 

0076 

24 

CO'ITIM'JF: 

0077 

DO  30  L 

• 

0078 

.V.2=0- o+1 

00  7  y 

l/'  30  ’0  =  1,0 

•00-d-i 

LZ=f.’-"-l  +1 

008 1 

30 

A (L  LZ )  =  A < LO , LZ ) -TP « P ( 

I!)*A(’'2,LZ) 

0082 

L'O  32  II  1  =  1, M 

0083 

32 

A(L",I  II)  =  A(L*»,  III)/TF’*P(L  +  I  ) 

0084 

DO  3'*  I=|,'.' 

•4:0  8  p 

l;’=i/-i+i 

00.86 

IF  (  180. {(!.?»)  .FO.LM)  GO 

TO  :5  o 

;'08  7 

!‘l  =  I:;0'.',(  LM) 

0085 

DO  o2  J=1 

008  y 

X=A(  J.!.M) 

00  90 

A ( J , L  )=A(J, “1 ) 

00  VI 

p2 

a  (  j  , ;  i  )= x 

0w  V2 

50 

COJ,TP"jP 

MK.V3 

or-Tijir- 

00  V4 

1  (*'* 

I F  A  I  L=  1 

80  VP 

tfPTUP*' 

80  VO 

E*!:; 

vex  :;r> 

:S^k  r'FOOP  -\0  =  Qno 

COP  MOM 

ur*r\r\rK 


i*’  A  (  »•- 


I 


INV 
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i  oy7 


a 


JS 

a 


is 

s 


■ti 


I 

1 

■'tr 


■i. 


| 

I 

5 

% 

t 


8 

?±! 

7; 
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0001  F?M,L 

0002  C 
0003  C 

0004  SUBROUTINE  PERT (11,1  .MAX , .J-'AX ) 

000b  C 
0006  C 

0007  CCCCCCCCCOCC 
0008  CCCCCCCCC CCO 
0009  CC 


00  1  0 

CC 

cd 

cd 

00  1  1 

CC 

THE  PURPOSE  OF  T-US  ROUTINE  IS  TO  SIMULATE  TARGET  MOTION  RY 

001  2 

CC 

THE  DATA  ARRAY 

cd 

0013 

CC 

*  '  •  , 

cd 

0014 

CC 

SOURCE  FILE: 

PEPTS  .  ; 

cd 

001  5 

CC 

‘  OPJECT  FILE: 

PERTR 

cd 

eg 

0016 

CC 

CALLED  BY  * 

CONT  ‘ 

0017 

CC 

cd 

00 1  S 

CC 

1 1 

I'tAGE  DATA  ARRAY 

eg 

001  9 

CC 

I  MAX  J  '(.AX 

DP'EMSIOMS  OF  DATA  ARPAV 

eg 

0020 

CC 

IS- 1 FT  4  JSHIFT 

SHIRT  FACTORS 

cd 

O02 1 

CC 

IPTR  A  JCTR 

LOCATION  INDICES 

eg 

0022 

CC 

cd 

0023 

CC 

eg 

0024 

CCCCCCCCCCCGCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCd 

002b 

CCC 

0CCCCCOCCCCCCC CCCCCCCCCCCCCCCCCCCCCCC CCCCCCCCCCCCCCCCCCCCCC  CCCCCCCCCG 

•0026 

c 

25 

I 

0027 

0028 

c 

INTEGER  I1(10",IOO) 

I 

0029 

c 

I 

GO  30 

/.RITE  (l,l'vO) 

•s 

5-0  3 1 

10 

1  Format  (" I . °UT  horizon 

TAi.  AND  VERTICAL  PFRTURRATIONS" ) 

I 

0032 

READ  (!,*)  ISl-’IFT,  JS'-IFT 

1 

T 

0033 

c 

O034 

L.0  3'0'  I  =  1,1  'AX 

i 

% 

003b 

DO  3-00  J=1,J:.'AX 

00-36 

I RTR=ISHIET+I 

O03  7 

J  PTP=.)S’J  I FT+J 

£ 

1 

00-36 

IF  ( ((  I'-T’-.’.LT.  1  )  .OR.  (IRTR.OT.  I;,AX) )  .OR.  ( (.IPTR.LT.  1  )  .op.  (. IPTR. 

GT.  I 

0039 

+J.“AX  ) ) )  GO  TO  300 

a 

004.) 

1 1  (  I  ,.!)  =  I  l  ( IPTR.JPTR) 

l 

i"’41 

30 

4  con  rr:u,T 

N 

3 

O042 

c 

3 

'.M.l  3 

:iETJk! 

I 

'4<44<1 

.  > 

O' 

00  4  D 

c 

s, 

% 

;0'4o 

Erl) 

% 

** 

in  fk 

-ORS**  "'RO'IRAV  =  00120 

CO.,,MOM  =  OO-'HOO! 

§ 

page  <W?  P-ET  FPJ4  CO’ipn.FRj  MP 241  77  (SFPT.  1974) 

1 

s 


CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCg 

ecccccccccccccccccccccccccccccccccccccccccccccceccccccccccc| 

cd 


-.’4  / 


EPOS 


S&&KqS8&Bi! 


0001 

0002 

0003 

0004 

003b 
0036 
0007 
00  ’8 


A- 34, 


PAGE  0001 
FTN4.L 


FTN4  COMPILER:  HP 24 1  77  (SFPT.  1974) 


SUBROUTINE  PANT(BI,B2> 


CCCC CCCCCCCCCCCCCCCCCCCCCC CCCCCCCCCCCCCCCCCCCCCCC CCCCCCCCCCCCCCCCCCCCCCC! 
CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC| 


0009 

CC 

0010 

CC 

001  1 

CC 

THE  PURPOSE  OF  THIS  ROUTINc  IS  TO  ALFR  THF  CAMERA  POSITION 

0012 

CC 

TO  COMPENSATE  FOR  TARGET  MOTION.  THE  SIGN  OF  THE  AFFFIHE 

0313 

.  CC 

ESTIMATES  ARE  EXAMINED 

TO  DETERMINE  FE  DIRECTION  OF  THE  MOTION 

0014 

CC 

• 

001  b 

CC 

SOURCE  FILE: 

PANTS 

0016 

CC 

OBJECT  FILE: 

PANTR  ‘ 

0017 

CC 

CALLED  BY: 

COMT 

00 1  8 

CC 

031  9 

CC 

-FIS  PROGRAM  CALLS  THE 

FOLLOWING  ROUTINES: 

0320 

CC 

MOTOR 

DRIVER  FOR  THE  PAM  TILT  MOUNT  - 

0321 

CC 

0322 

CC 

HI  4  R2. 

AFFINE  ESTIMATES 

0023 

CC 

I STEP!  "  ISTEP2 

CAMERA  MOVEMENT 

0024 

CC 

•JSTE PI  *  JSTEP2 

TEMRORARTY  STORAGE 

002b 

CC 

I  PER 

PAN  TILT  SPEED  CONTROL 

002c 

CC 

I  1)1  R 

PAN  TILT  DIPECTION  CONTROL 

002  7 

CC 

0028 

CC 

002  9 

0033 

0031 

0032 

0333 

0034 

303b 

003* 

033  / 

003b 

003  9 

01-40 

004  1 

'.1342 

3C543 

0044 

004  b 
O04o 
034  / 
3,048 
004  y 
00b0 
03o  1 
•303  2 
V.1b3 


CCCCCCCCC CCCCCCCCCCCCCCCCCCCCCCC CCCCCCCCCCCCCCCCCCCCCC CCCCCCCCCCCCCCCCCG] 


C  CCCCCCCCCCCCC  CCCCCCOCOC CCCCC 

c 


JSTEP I  =1 
JSTE  P2= 1 

IF  (HI .E0.3 )  JSTE PI  =3 
IF  (B2. E0.M )  JSTFP2=3 
I  PER =3 
hi=-m 

rS2=-B2 

IF  ( (i'.l  .LT.-3) .  AMO.  (G2.I.T.3) )  IDIR=1 
IF  ( (N1  .  LT.  M).  AND.  ( ,J2.  rrE.  '11) )  IPIR^ 

IF  ( (’’  I  .GE. .  A'-'O.  (H?.r:E.n) )  1^16=2 
IF  (CM.GF.O).  VJi).(”2.LT.3>) 

..mitik  i  ,  r,',«>  i  *?i h 

1  FOR  "AT( "  !)l  3 FCTirV! "  ,  1 6 ) 

CAM.  "OTORC  1  2,  HTF  PI  ,  IST:-P?,  I  DIE,  I  PEP) 
pos  |  =O0S  1  -*S  101!  (JSTE  PI  ,HI  ) 
pPS2  =  pos 2  +S I  ON  ( JS  TEn 2 , 2  ) 


RETURN 


MC  ER.^RS-f* 
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ppnr;i;Aw  =  C'^2'16 


CO’.P'O’i  = 


PANT 


FTm4  CO’<pT i.FP :  Hpp/,177  (SEPT.  1^74) 


0034 


PA  OR  0001 


FTN4  COMPILER:  ' 1P24I77  (SFPT.  1974) 


OOMJ 

0002 

0003 
0D04 
0008 
0006 
O0O7 
0008 
0W0  V 
00 1  0 
001  f 
150 1  2 
00 1  3 
0014 
0015 
00 1  6 
■Oil  I  7 
0018 
O0 1  y 

»/j0  20 
■0021 
•4022 
0023 
4024 

00  2d 
0026 
0027 
0026 
0029 
0030 
0031 
0O32 
0033 
0034 
4038 
0036 
0437 
•0038 

403  y 

'.;v ’40 
•404  I 
■404  2 
•.7043 
.’044 
0040 

0040 
•  ’04  / 
'  V04H 

404  </ 
.•'..8!' 
::'d  I 
008  2 
4083 


.FTI4,!. 


SUBROUTINE  DRIVE 


cccccccccccccccccccccccccccecocccccccccccccccccccccccccccccocccocccecccc 

CCL'CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC 


THE  PURPOSE  of  TH I S  ROUTINE  IS  TO  ALLOW  THF  OPERATOR  TO  move  OR  CO 
POSITION  T>lE  CAMERA  SENSOR  SOME  SPECIFIC  AMOUNT.  CC 


SOURCE  FILE: 
OBJECT  FILE: 
CALLED  BY: 


DR  I  VS 
DRIVR 
COMT 


THIS  PROGRAM  CALLS  THE  FOLLOWING  ROUTINES : 


MOTOR 


I STEP  I 


ISTEP2 


I  PER 

0OS1  2.  P0S2 


ASSEMBLY  LANGUAGE  DRIVEP  FOR  p*NT  TILT  CC 
MOUNT  CC 

CC 

NU-'BER  OF  :'OTOR  stfps  in  Y  DIMENSION  CC 
1  STEP  =  0.03  DEGREES  CC 

NUMBER  op  MOTOR  STEPS  IN  X  DIMENSION  CC 

1  STEP  =  o.06  DE ORFFS  .  CC 

DIRECTION  OF  ROTATION  CC 

0  CC.;  TILT:  ccv;  PAN  CC 

1  CW  TILT:  CCW  PAN  CC 

2  CC .1  TILT:  CW  PAN  CC 

3  CW  TILT:  CW  PAN  CC 

MOTOR  S3CED:  1  LOVC  2  MFDIUH*  3  HIGH  CC 

CURRENT  CANPRA  POSITION  CC 


CCCCCCCCCCCCCCCCCCCCCCGCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC 

CCCCCCCCCOCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC 

c  .  I 

C  3 

INTFGER  I  ST  ART,  JST  ART,  I  STOP,  JSTOP.  I  COUNT,  I l'AX ,  JUAX,  I  pOSI  ,Ipr>S2  1 
I  I'D' EGER  J  POS 1  ,  J  P0S2 ,  1 0|  >E  V ,  I  01 SP ,  I V I E  W .  I  Do  FT ,  I  MOVE ,  P'LAO,  I  m ,  jo  f 

INTFGFR  ISTEP1  , ISTEP2, IDIR,oOS1 ,pOS2  I 

COMMON  I  START, JST ART, I  STOP, JST°P, ICnUNT, I MAX, JMAX , I POS 1 , 1 FDS2  I 
COMMON  J  60S  1  ,J?OS2,IOOr-;v,IOISr>,TVn-''J,IOOPT,r’OVP,pVAG,  I0,JO  i 

CO  •’"O’!  I  ?TEnl  ,  I S TCP 2 ,  I O I R ,  POS  1  ,  pns  2  1 

c  I 

r» 

C  % 

C  INITIALIZE  PAN  TILT  PARAMETERS  i 

.<»ITE(  1 ,  1*)  *  I 

!"•  FOR  'AT( "ENTER  -SrE^S  FOR  p\N  AN"  TILT  AMD  DIRECTION")  I 

HEAw(  1  , *)  ISP-:?1  ,ISTEn?,IDI6  i 

I  PFR=3  t 


CALL  ORIV-R  TO  vo VP  pA't  TILT 

CA  !.L  *,f'T0R(  1  2 ,  ISTEn1  ,  ISTED?,  ID  IP,  I  Fc:j ) 

CALCUf.A  D;  NP.\  CA,,t:n a  ROSITIO'-'  .  ! 

PAGE  0002  DRIVE  FT’M  COMPILER:  '’924177  (SFDT.  1974) 

IF  ( ( IDIR.EO.o)  ,nR.  (  IDIR.PO.  2))  IST;?!  =-ISTcPl 

t  —  r  f  T  T  '  *"* •  \  rv. »  f  I  DT  .*>  r*o  t  \  a  TC,r'*  t  r-T- 


/  'I'J 


•3060  P0S2=P052+IS  iE?2 

0061  C 

0062  RETURN 

0063  C 
0064  C 

0066  EMC 

**  NO  EHh02S*x  PHOORO.*.  =  00102  CM'MON- »  00^24 


A- 36 


RAGE 


.•*003  O^IVE 


FTM4  COOLERS  UP241 77  (SF?T.  1974) 


A- 37 


In 


HACK  i 

'  MvJtt  1 
L‘  CAS  ! 
.ENTH  : 

!  PAH  i 
L  ORB  I T 
IOUEV 
I  MASK 
XSTRT 
YSTKT 
,  YSTOP 
!  OUT 
I  ■**  NO 


ASMB,I.,R,T 


R  .00(:j!V!6 
X  OHCBC'I 

R  900003 
R  09906  I 
H  900062 
R  0CV*o 63 
R  200064 
R  000065 
R  90*1066 
009032 
)  ERRORS-* 


FACE  9C?fl2  -■■'•''I 


2091 
W002 
!  V003 

1  '  (JK04 


AS. "IT 


-v/:-u50 


,  BMW 5 

"0V00  < 

•'099.-10 

(  ;  0906 

:,)M'206 

K'M'5000 

l  i  7 

007  ( 

:  1  69’'  I  X 

0003 

0.001 0  •: 

lOORR.V'R 

v)'/0  V 

000  1  1 

193100 

0(3 1  M 

;;ryi2  062062k 

‘  00 1  1 

'•>00 1  3 

192696 

.  O0 1  2 

0001  4 

1  90  '/< 

e/01  3 

000. 1  t> 

162906k 

!  •  ,;.{)|  4 

:j  1  o 

'32061  R 

(;0  1  5 

0091  7 

1  02602 

[  j  00' 1  <> 

>  KM20 

192792 

[  ;  OOl 7 

00021 

1  n2O0  "Ok 

00 1  H 

•0f>'4  22 

*‘V  ‘  3  o' '/  '1 

1  i  w'll  v 

V.0-.123 

:  ->020 

•'M92'*- 

1 02602 

'  00  21 

'.:•••.;  2o 

i  62*  "09R 

;  ..0  22 

26 

01  2"*  43  R 

:  </023 

>0027 

,3;’964r’ 

|  L  ..0-24 

/3>' 

1 92632 

00-2U 

.•0031 

|  / ; )  7  T-i 

i  :  U!2o 

'  '"'32 

1  ’.'.733 

1  ■  vj0-2  / 

10933 

1 6299 1 R 

;  ,.':2>'. 

34 

o-l  2-’69R 

..02l> 

3 

•532'V»Bi' 

1  '.;03> 

-■093o 

1 "263  2 

,.031 

0-037 

l  ’2722 

;.0j2 

0002  > 

1  '0/32 

|  h  .-0  33 

•.  '■  ’94 1 

1  TO ’"2  k 

|  |  !  03'* 

0  04  2 

1  ’4033 

.0.  3o 

*43 

1  V.  732 

n  ■.  >'3<» 

*  •  v.«: 

1  ’o73  2 

I  Al 

>  '4  •; 

1  6  2- 4 

•1  2-,6'9 

. .  v  >3 3  v 

'4  / 

>32Mo;)f 

.  n .  04  ‘ 

*0.  ;;  1 

1  "263  2 

V  u  -VM 1 

.9  03  1 

i  *273  2 

1 1 A  9 

CAS « 7 

ENT 

CAS 

EXT 

.  PMTR 

ESS 

6 

NOP 

JS3 

.  EM  TR 

OFF 

PAR 

CLP 

(A 

IT)  A 

IO0EV 

OTA 

6 

CI.C 

2 

l.PA 

PAR +  5 

I  OR 

ORO  I  T 

OTA 

2 

STO 

2 

I.OA 

PAR+4,  I 

C9A 

IN\ 

OTA 

2 

r.n\ 

PAR,  l 

MM) 

MASK 

TOR 

XSTRT 

n-fA 

OUT 

S  TC 

OUT 

01.0 

OUT 

I. BA 

PAR+1 , ! 

MM> 

"AS1' 

I  OR 

YSTRT 

OTA 

OUT 

STO 

OUT 

01 .0 

OUT  * 

1.0' 

PAP +.?, 

•  OTA 

"UT 

9  TO 

OUT 

01.0 

niiT 

p.'!>x3. 

. 

\mo 

’•AS1' 

I.OR 

YSTOP 

:oT.' 

OUT 

-  ■—••*»*  *r  1  * 

n  I  w 

.  *  ►' 

■  0UT"-“ 

9A® 

;#* 

& 


A- 39 
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;W3 I 
MOTOR  r 
.  ENTR  X 
PAH  H 
PULI  H 
,'.-0  TO  I  R 
ZKHm  H 
...OT2  H 
FUL2  H 
;/.oin2  « 
Z£:i')2  H 
FIN  R 


ASVT.L, R, T 


.-.nil  R 
;.  .0 1  2  H 
.  ..02 1  R 
022 

istf:i  r 

1STE2  R 
1 01  w  W 
IP  Eh  h 

r!:R  H 

rEH  I  R 
i-SR2  H 
rE>;3  H 
P !: t*;  I  2  < 

22  H 
rEM’32  H 
ST  El  R 

rH2  R 
ZE  2  rf 
STEP  R 
PHI  R 

Zi:  I  !•: 

t; 

1.00  02  H 
A/:' 


!i(W05 

oogooi 

<■  tooo  4  3 
(.W0MS4 

o^o-rr/P 
000105 
U0ff I  I  4 
000 1  24 
000 1  4  2 
0001  ‘jo 
0O0 | o 1 
0001 62 
OOt-M  n3 

00v‘  I  64 

1 1  ob 
(  |  oo 

:’ooio7 
■•'OO  |  7 1 
LOO  I  71 
0001 72 
0001 73 

(VO "5 1  /4 
MOO  |  7  ij 

•'00  1  75 
cool  77 
000  2' 
00;  .. 2’'  I 
f/oipop. 
Moo 2  >3 
0002 A 

OOM2C'3 
2”.  6 
•  .707 

'O' 52  I  0 
•'602  I  I 
M60;,  |  2 
00  2 1  3 
,  :'000  I  n 
ERRORS  -v 


A ?  • 

A'i’-' 

4> 


E  ■:  10,2 


00000 


,.'MMb  'VS"'i 
V—fVi  '.'I  IT 
■OVV-V  ••  -ioo-  ’H 
'  .10  I  '51 
’'•oil  1 52'"‘|;R 
■50012  : 72 17l/< 
'•0015  JAplolR. 
.VOM  :,7)306;i 


A3  0fM..:«,T 

MAO  M'vrnw,7 
FOX  MOT™! 
CXT  .  POTR 
l-  ‘  I?  OSS  b 
•6  TON  imp 

.ISO  .P‘«T!? 

PAR 

S’  r  ' 

■  j'h  ^AH+1  .  I 
“:0  C"-\  V  ' 


r 

£* 


§ 

£* 

! 


I 


I.- 


i 

s 

6 

V 


1 


i 

i 

i 


—  '  *: 

.  _ 

i 

v  !u 

'  ‘  ‘i  / 

1  -  >2  ‘  ••••  •. 

i  '  • 

.-••••  . : 

3 

u:  I  7 

T  '20 

"721  7  4  p 

STA 

i 

iO !  1  •> 

o  '2 1 

'321 1  ■ 

<•  r  * 

oi 

A-40  | 

;?!  '•  1  V 

22 

••Po-ps.- 

j”~ 

V+C 

•r 

..v  ■••■'?  3 

*b2 1  o 

r*  _»• 

!  2 

i  021 

pe:  2iJ 

.'  2o;,4-‘I 

J*V 

-:+ 1  2 

s 

o-.  2.-: 

COM  2b 

'■*)22- *'*!•; 

o-;;  3 

1 

v;-2J 

■v*2y 

.'72213:-: 

sta 

in--) 

'•f  ’2  / 

.-622- ‘3c 

i.i'A 

P::-3? 

or  2  b 

•f  V3* 

:'723l  3-: 

r*''  4 

• %  i  *\ 

f  ..‘2 

1 

v.02o 

■*{•—31 

‘ '  20  "4  3i- 

.r- 

-  "j*.  i 

JC27 

'V032 

*o21 

l:  a 

•'i-  :i 

002c 

■:—33 

• "  i  2  o  ( .■•;: 

-t  •, 

UVVI 

;7j 

;  l  2y 

3-i 

•■62.?*1!' 

L--\ 

3=  <  1 

3 

i.’i  J1. 

*3b 

■  '7221  31- 

S  TA 

LO'"'  2 

g 

1  .-31 

;*-v'3o 

'2  o ''/I.'*.' 

t  *0 
*» 

r'ii'.l 

l 

*.■'32 

:*'’037 

.:621  77:: 

IR\ 

j=s;6 

! 

00-33 

OC.l'V 

C7221  20 

STA 

(  066  J 

0034 

*41 

{‘o22’22 

L :  A 

22 

§ 

t,!'35 

••{'042 

'•7221  3:-: 

ST  A 

!.nnP2 

1 

(>03o 

00043 

1620 030 

R'Ll 

i.i'A 

.•'V*+3. 1 

a>j7 

•«{*{’ 4  4 

•  72  1  /.V 

S  T-\ 

I  'ir 

-s 

i;>'3S 

noca- 

:*  1 2  1  o  1  K 

a  on 

ni 

% 

UP39 

•0"“4o 

■■52  loll: 

C  r  * 

31 

{•••'04  7 

/  2o  1 0 

i  ■■  b 

*+2 

| 

00.41 

i  vob:.' 

02oro3? 

j-p 

•*.+3 

si 

UM2 

■■■V  :,-5l 

'•■o2  1  o*3:# 

I.:  •\ 

•  'Oj  1 

S 

0343 

*,2of’:'4k 

J’V 

•  /'TO  1 

J 

0044 

;5f‘}b3 

.-.62 !  r>63 

LDA 

:o  ]  p 

t?04b 

ii*n'b4 

J3o?-4.? 

;'oto  i 

is;: 

STT1 

| 

00  4  6 

MOObb 

.'2o‘*57H 

J>!6 

x+2 

9 

i;04  7 

•OR*  bo 

02  or' 60 

.J’V 

'OTP 

1 

004b 

;;••:•  Ob  7 

1  -2616 

OTA 

V' 

l 

i;;4  v 

••'•*  '63 

.-•6221  2:> 

!.!>A 

1.0061 

i 

GOb:) 

-5!  *361 

(-7221  'U 
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6C| 

i 

oobi 

•};‘‘3o2 

’■'3o2 1  -R 

IS7. 

3=1 

| 

Wb2 

3!  063 
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•--+2 

1 

00b3 

c'f  064 

026^72!' 
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j| 
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n 
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■00067 
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1 

fi 

>, 

! 

i 

% 


PAGR 
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Ml 

003  7 

0(07;: 

02c>(  -67R 

J  03 
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oobb 

0O(A71 
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Jf-v 

-—7 

00b  9 

001572 
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UR 
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Z'-l 

00  6  J 

;no7o 

■•3o21  IP 
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